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ABSTRACT 



An apparatus and method are disclosed for generating and 
displaying three dimensional representations. In one 
embodiment, a data structure is disclosed. The data structure 
is suitable for storing information useful in constructing a 
three dimensional representation of information in a view- 
able construction site that is conceptually divided into a 
muhiplicity of locations. The data structure is embodied in 
a computer readable media and includes a pluraUty of 
attribute maps. Each attribute map is arranged to associate 
specific attribute instances with specific locations within the 
construction site. The data structure also includes a plurality 
of attribute descriptors. Each attribute descriptor is associ- 
ated with one of the attribute maps and is arranged to 
reference specific attribute instances associated with the 
associated attribute map. 

30 Claims, 36 Drawing Sheets 
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ARCHITECTURE AND METHODS FOR 
GENERATING AND DISPLAYING THREE 
DIMENSIONAL REPRESENTATIONS 

CROSS REFERENCE TO RELATED 5 
APPUCAnONS 

This application claims priority to Provisional U.S. Patent 
Application, having application No. 60/103,710 filed Oct, 8, 
1998 entitled, "Architecture and Methods for Generating 
and Displaying Three Dimensional Representations" by 
Miodon^, et al. This applications is related to concurrently 
filed U.S. patent, application Ser. No. 09/183,642 entitled, 
"Systems and Methods for Di^laying Three Dimensional 
Representations" by Bank, et al., which has assignment 
rights in common. These two related applications are incor- 
porated herein by reference for all purposes. 

BACKGROUND OF THE INVENTION 

The present invention relates generally to mechanisms for 
generating and displaying three dimensional representations 
or virtual reality worlds. That is, the present invention relates 
to methods and apparatus for building and viewing such 
three dimensional worlds. 

One conventional mechanism for creating and displaying 
three dimensional (3D) worlds implements virtual reality 
modeling language (VRML). Conventionally, VRML is 
used to "model" three dimensional worlds using simple 
polygon structures. The first version of VRML allows for the 
creation of virtual worlds with limited interactive behavior 
and is currently the most popular foundation for creating 
interactive 3D multimedia on the Internet. As will be appre- 
ciated by those skilled in the art. International Standard 
ISO/lEC 14772 describes the standard VRML file format. 

Worlds created using VRML can contain objects which 
have hyper-links to other worlds, HTML docimients or other 
valid MIME types. When the user selects an object with a 
hyper-link, the appropriate MIME viewer is launched. When 
the user selects a link to a VRML document from within a 
correctly configured WWW browser, a VRML viewer is ^ 
launched. 

Although the conventional VRML viewer work well 
under certain conditions, it has associated disadvantages. 
For example, if the 3D world is relatively large, it is diflBcult 
to orient oneself within the world. That is, as one navigates 45 
within the 3D world, it is easy to get lost. This is partially 
because standard VRML viewers do not provide any frame 
of reference for where you are currently located within the 
VRML 3D world. Additionally, even when a 3D world is 
relatively small in size, navigational problems may still arise 50 
when certain portions of the 3D world have a similar 
appearance. In this case, it is especially diflBcult to distin- 
guish between similar portions of the world and navigate to 
a desired location of the 3D world. 

Navigational problems are compounded since each 55 
VRML world may have an infinite size. In other words, there 
are no constraints placed on how large a VRML world may 
be. Thus, VRML world builders may build relatively large 
and complex worlds. As VRML worlds becomes larger and 
more complex, it becomes increasingly more diflScult to 60 
view and navigate through such gargantuan worlds. Finally, 
when a VRML world is relatively complex, it requires a 
relatively long rendering time since each portion of the 3D 
world is analyzed and rendered from polygon structures. 

In view of the foregoing, there is a need for improved 65 
mechanism for generating 3D worlds and viewing and 
navigating through such 3D worlds. 



SUMMARY OF THE INVENTION 

Accordingly, the present invention provides an apparatus 
and method for generating and displaying three dimensional 
representations. In one embodiment, a data structure is 
disclosed. The data structure is suitable for storing infonna- 
tion useful in conslmcting a three dimensional representa- 
tion of information in a viewable construction site that is 
conceptually divided into a multiplicity of locations. The 
data structure is embodied in a computer readable media and 
includes a plurality of attribute maps. Each attribute map is 
arranged to associate specific attribute instances with spe- 
cific locations within the construction site. The data structure 
also inchides a plurality of attribute descriptors. Each 
attribute descriptor is associated with one of the attribute 
maps and is arranged to reference specific attribute instances 
associated with the associated attribute map. 

Id an alternative embodiment, each attribute map has a 
plurality of identifiers, wherein each identifier is associated 
with a specific location within the construction site and a 
specific attribute instance, and each attribute descriptor is 
formatted to match ^ecific identifiers of the associated 
attribute map to specific attribute instance. Additionally, 
specific identifiers are matched within the descriptors to 
specific attribute instances located within the descriptors, 
and other specific identifiers are matched within the descrip- 
tor to specific indexes that reference specific attribute 
instances located outside of the descriptors. 

In yet another embodiment, a data structure for holding 
information that is convertible into a three dimensional 
representation within an audiovisual system is disclosed. 
The three dimensional representation includes a plurality of 
sections. The data structure has a mapping portion that 
associates selected sections of the three dimensional repre- 
sentation with selected section attribute instances. At least 
one of the section attribute instances is viewable or audible 
within the audiovisual system. The data structure further 
includes a general portion that associates general attributes 
with the three dimensional representation, at least one of the 
general attributes being viewable or audible within the 
audiovisual system. 

In a method aspect of the invention, a method for gener- 
ating a three dimensional representation in a viewable 
construction site having a plurality of sections is disclosed. 
Each section has a plurality of associated attribute layer. A 
new construction site is instantiated; a first attribute layer is 
selected; and a first palette that includes a first plurality of 
attribute instances associated with the first attribute layer is 
displayed. A first attribute instance from the first palette is 
selected; and the first attribute instance is painted on one or 
more sections of the construction site. 

These and other features and advantages of the present 
invention will be presented in more detail in the following 
specification of the invention and the accompanying figures 
which illustrate by way of example the principles of the 
invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be readily understood by the 
following detailed description in conjunction with the 
accompanying drawings, wherein like reference numerals 
designate like structural elements, and in which: 

FIG. 1 is a diagrammatic representation of a system for 
building and displaying 3D worlds in accordance with one 
embodiment of the present invention. 

FIG. 2 is a diagrammatic representation of the data 
structure of FIG. 1 that may be used by the viewer to display 
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a corresponding three dimensionaJ world in accordance with FIG. 16 is a screen shot illtistrating the construction site 

one embodiment of the present invention. of FIG, 15 after a it ha s been populated with a t our route 

FIG. 3 is a diagrammatic representation of a particular ^ accordance with one embodiment of the present inven- 

location in the construction site and the location's associated ^on. 

identifiers and attribute instances in accordance with one 5 FIG. 17 is a screen shot of a portion of a three dimensional 

embodiment of the present invention. world rendered from the populated construction site of FIG. 

FIG. 4 is a diagrammatic representation of the descriptors }^ in accordance with one embodiment of the present 

and the general data portion of the data structure of FIG. 2 invention. 

in accordance with one embodiment of the present inven- FIG. 18 is a screen shot of a tool bar within the builder of 

tion. FIGS. 6 through 17 in accordance with one embodiment of 

FIG. 5 is a screen shot of a viewable portion of a three P"^esent invention, 

dimensional world that has been generated and displayed in FJG. 19 is a flowchart illustrating a process for populating 

the viewer in accordance with one embodiment of the or modifying a construction site in accordance with one 

present invention. embodiment of the present invention. 

FIG. 6 is a screen shot of ttre builder of HG. 1 having a RG. 20 is a flowchart illustrating the operation of FIG. 19 

graphical user interface for populating a particular construe- ^f populating or editing the attribute maps in accordance 

tion site and generating a three dimensional world based on embodiment of a present mvention. 

the populated construction site in accordance with one FIG. 21 is a flowchart illustrating the operation of FIG. 20 
embodiment of the present invention. 20 performing a paint operation in accordance with one 

FIG. 7 is a screen shot of an emblem dialog box in embodiment of the present invention, 

accordance with one embodiment of the present invention. HG. 22 is a flowchart illustraUng operaUon of FIG. 20 for 

™„ OA • t- . -It . 1 r^t. i3 performing an erase operation in accordance with one 

FIG. 8 A is a screen shot illustratuig selection or the floor uj- *r*t. *• 

* i_ r r-T^ ^ - J -^1. u J • * r *!. embodiment of the present mvention. 

tab of FIG. 6 m accordance with one embodmient of the . « f .1 . 

. • ^ 4- 2s FIG. 23 IS a flowchart illustrating the operation of FIG. 21 

present mvention. ^ , . . , , • 

„^ „^ . . .„ . . . . for applymg the selected attnbute instance to the selected 

FIG. 8B IS a screen shot illustraUng the construction site iocation(s) in the construction site in accordance with one 

of nG. 8A after it has been populated with several different embodiment of the present invention. 

floor objects in accordance with one embodiment of the '%a - a 1 ^ •« * *• r r-r^ c 

1 ^ . FIG. 24 IS a flowchart illustrating operation of FIG. 20 of 

^ 30 performing an attribute modification operation in accor- 

FIG. 9A is a screen shot illustrating the construction site j^nce with one embodiment of the present invention, 

of FIG. 8B after it has been populated with several different ^ ^ ^o^oh^ti illustrating the operation of FIG. 19 

types of wall objects thereon m accordance with one compiling a completed construction site in accordance 

embodiment of the present invenUon. embodiment of the present invention. 

FIG. 9B is a screen shot showing a dialog box for 35 FIG. 26 is a flowchart Hlustrating the operation of FIG. 25 

modifying characteristics of a particular wall object of FIG. processing image data in accordance with one embodi- 

9A in accordance with one embodiment of the present Qj^nt of the present invention. 

invention. FIG. 27 is a flowchart illustrating the process of FIG. 26 

FIG. lOA is a screen shot illustrating the construction site of processing image layers in accordance with one embodi- 
of FIG. 9A after it has been populated with several different 40 ment of the present invention. 

types of sprite objects in accordance with one embodiment pj^ 28 is a flowchart illustrating the operation of FIG. 27 

of the present invention. updating the buUder layer table and attribute layer map 

FIG. lOB is a screen shot illustrating a sprite dialog box in accordance with one embodiment of the present inven- 

1050 for modifying characteristics of a sprite object of FIG. tion. 

lOA in accordance with one embodiment of the present piG. 29 is a flowchart illustrating the operation of FIG. 26 

invention. for generating the birdseye view in accordance with one 

FIG. 11 is a screen shot illustrating the construction site embodiment of the present invention, 

of FIG. lOA after it has been populated with several different EHG. 30 is a flowchart illustrating the operation of FIG. 26 

types of sound objects in accordance with one embodiment for constructing the color palette in accordance with one 

of the present invention. embodiment of the present invention. 

FIG. 12 is a screen shot illustrating the construction site FIG. 31 is a flowchart illustrating the operation of FIG. 25 

of FIG. 11 after it has been populated with several different for processing non-image data in accordance with one 

types of links in accordance with one embodiment of the embodiment of the present invention, 

present invention. FIG. 32 is a flowchart illustrating the operation of FIG. 31 

FIG. 13 is a screen shot illustrating the construction site for processing the attribute layer in accordance with one 

of FIG. 12 after it has been populated with several different embodiment of the present invention, 

types of "Borg" links to other three dimensional worlds in FIG. 33 is a flowchart illustrating the operation of FIG. 25 

accordance with one embodiment of the present invention, for compiling the data structure in accordance with one 

FIG. 14 is a screen shot illustrating the construction site go embodiment of the present invention, 

of FIG. 13 after it has been populated with several different FIG. 34 is a flowchart illustrating a process for editing a 

types of blocking objects in accordance with one embodi- particular palette of attribute instances within the builder of 

ment of the present invention. FIG. 1 in accordance with one embodiment of the present 

FIG. 15 is a screen shot illustrating the construction site invention, 
of FIG. 14 after it has been populated with several different 65 FIG. 35 is a flowchart illustrating the process of creating 

types of ceiling objects in accordance with one embodiment a sprite object in accordance with one embodiment of the 

of the present invention. present invention. 
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DETAE^D DESCRIPTION OF SPECIFIC 
EMBODIMENTS 

Reference will now be made in detail to a specific 
embodiment of the invention. An example of this embodi- 
ment is illustrated in the accompanying drawings. While the 
invention will be described in conjunction with this specific 
embodiment, it will be understood that it is not intended to 
limit the invention to one embodiment. On the contrary, it is 
intended to cover alternatives, modifications, and equiva- 
lents as may be included within the spirit and scope of the 
invention as defined by the appended claims. In the follow- 
ing description, numerous specific details are set forth in 
order to provide a thorough xmderstanding of the present 
invention. The present invention may be practiced without 
some or all of these ^cific details. In other instances, well 
known process operations have not been described in detail 
in order not to unnecessarily obsciire the present invention. 

In general terms, the present invention provides mecha- 
nisms and techniques for generating and displaying three 
dimensional (3D) representations or worlds. A 3D world is 
a virtual reality type environment that includes a plurality of 
3D objects that are displayed or executed within the 3D 
world. The present invention allows a user to build 3D 
worlds and/or display 3D worlds and navigate through such 
displayed 3D worlds. 

A builder graphical user interface is provided that allows 
a user to populate a construction site with objects or links 
that may be displayed as an associated 3D world. For 
example, one or more objects and/or links may be placed at 
one or more particular locations within the construction site. 
The construction site and associated objects and/or links 
may then be compiled and organized within a data structure 
that is then used to generate a 3D world. The data structure 
is organized such that specific locations within the construc- 
tion site and associated objects and/or links correspond to 
specific tocations within the 3D world. 

The objects and/or links may take a wide variety of forms, 
such as image files for forming 3D objects, sound files, 
executable objects, video clips, links to other 3D worlds or 
to other objects (e.g., URL addresses to web sites), etc. 
Three dimensional objects may be displayed within the 3D 
worlds as part of the virtual reality environment. For 
example, a 3D object may be in the form of a building that 
a user may navigate around and view from varioiis angles. 
A sound objects may be associated with particular locations 
within a 3D world and played when a user moves over such 
particular locations, for example. Likewise, links to 3D 
worlds or to other objects, such as web pages, may be 
associated with particular locations and 3D objects within a 
3D world. The referenced objects may be executed when a 
user moves over the particular locations or bumps into the 
associated 3D objects, for example. 

By layering the objects and links together on a particular 
location, a rich realistic 3D environment may be provided. 
Additionally, when executable objects and/or links are asso- 
ciated with 3D objects, the resulting 3D world provides a 
visually appealing and logical mechanism for displaying and 
organizing links and objects. For example, a web page for a 
music commerce site may be associated with a meaningful 
3D object, such as a 3D music store. 
Architecture Embodiments for Generating and Displaying 
3D Worlds 

FIG. 1 is a diagrammatic representation of a system 101 
for building and displaying 3D worlds in accordance with 
one embodiment of the present invention. As shown, the 
system 101 includes a builder 100 for generating a data 
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Structure 106 for a particidar 3D world and a viewer 102 for 
displaying the 3D world based at least, in part, on the 
generated data structure 106. 

The generated data structure 106 includes references to a 

5 plurality of assets 108. These assets 108 may include any 
suitable data objects and/or links that may be viewed, 
played, or executed within an audio visual environment. Of 
course, the assets 108 may include merely image files, audio 
objects, video objects, executable objects, or any combina- 

10 tion thereof. In one embodiment and as shown, the assets 
108 include image files 112, video clips 113, wave type 
sound files 116, MIDI sound files 114 and sprite files HO. 
Wave type sound files refer to a digitized sound file, while 
MIDI refers to a file that is used to synthesize sounds 

15 through the use of sound descriptions. 

The generated data structure 106 may also include links to 
objects. As shown, the data structure 106 may include object 
litis 120 (e.g., web links) and other world links 121. The 
generated data structure 106 may reference objects that are 

20 located outside of the data structure 106 or within the data 
structure 106. 

When a 3D world is displayed based on the generated data 
structure and associated links and objects, the links and 
objects are transformed into interactive cAjects within the 

25 3D world. For example, image files may be converted into 
3D objects that arc displayed within the 3D world. The user 
may navigate around such 3D objects. Additionally, the 3D 
objects within the 3D world may be associated with execut- 
able objects or links that reference executable objects. For 

30 instance, a web page may be loaded when a user navigates 
near or into a 3D object that is associated with a web link. 

The object links 120 may take any suitable forms that are 
executable by a computer system. For example, the object 
links 120 may include a link to an executable file or a link 

35 to an input to a particular application (e.g., URL sites or 
spread sheet docimtients). The data structure 106 may also 
reference other data structures 121 for other 3D worlds. 
Thus, several 3D worlds may be linked together to form 
complex superstructures. 

40 Image files referenced by the data structure 106 may be 
used to generated 3D objects within the associated 3D 
world. That is, the images may be used by the viewer 102 to 
render portions of the 3D world. For example, floor images 
may be used to render a floor and/or other type of ground 

45 covering within a mall; ceiling images may be used to render 
the ceiling of such mall; and wall images may then be used 
to render various vertical structures within the mall. For 
example, the wall images may include doors to various 
shops within the mall, columns, windows, an exit that 

50 includes a view to other buildings outside of the mall, or a 
stairway within the maU. Several specific examples are 
illustrated below in reference to FIGS. 6 through 19. 

The image files may be configured in any suitable form 
for rendering 3D objects. For example, the image files 112 

55 are in the form of two-dimensional (2D) images that are used 
to render 3D objects within the associated 3D world. In one 
embodiment, the image files include 2D images for gener- 
ating building, walls, floors, and ceilings. The image files 
may be in any suitable image format for representing 

60 images. For example, the image files may be in the form of 
bitmap or JPEG image files. Although the images are 
described as being resident in a plurality of files, of course, 
the images may be integrated within a single file or within 
any other type of computer readable object or objects. 

65 The data stmcture may be configured to reference any 
type of sound objects for adding sound to a displayed 3D 
world. One or more sound object may be played within the 
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3D world. For example, several sound objects may be 
blended together or a single sound object may be played at 
a particular location within the 3D world. In one 
embodiment, the data structure 106 references wave type 
sound files 116 and MIDI type sound files 114, The sound 
objects may be formatted within one or more files or any 
other type of computer readable object or objects. 
Alternatively, sound objects may be streamed live from 
another source, such as a microphone or a video camera. 

The data strucnire may also be configured to reference 
one or more sprite objects. Sprites may be in the form of 
objects capable of approximating 3D objects within the 3D 
world. A ^rite contains references to 2D images that are 
stitched together to simulate a 3D object. For example, 
photographs are taken of a real-life 3D object at various 
angles. A photo of a house may be taken from the front, the 
left side, the right side, and the back side of the house. These 
photographs are then stitched together to foraa a 3D object 
that is viewable within the 3D world from various an^es. 
Photographs of a real-life 3D object may be generated for 
any suitable number of angles, depending on the desired 
level of accuracy and realism of the resulting simulated 3D 
object. For example, a person may have to be photographed 
from several angles to effectively simulate the person in 
three dimensions. 

Alternatively, a sprite object may be in the form of a 3D 
object that appears to rotate when viewed from a single 
location within the 3D world. In one embodiment, 2D 
images may be sequentially displayed from a single angle to 
give a "rotating" effect Of course, the 2D images may be 
sequentially played at varying angles such that the 3D object 
appears to rotate when viewed from any angle. Another 
sprite object may be in the form of a animated sprite object 
that is displayed on another 3D object such as a wall object. 
For example, the animated sprite object may be an adver- 
tisement billboard that displays a video clip. 

The data structure 106 may also reference tour description 
lists 125. The tour description lists 125 are used to define 
specific routes in the 3D world that the user may select 
automatically. For example, a user may choose a route that 
takes the user from shop to shop within a mall. Various 
events may occur while the user automatically travels along 
the predefined route. By way of example, various sounds 
may be initiated and/or video clips may be executed at 
various points along the predefined route, and these sounds 
and/or video clips may be terminated at other points along 
the route. Thus, the tour description list 125 may reference 
tour MIDI sound files 126 tour wave sound files 127, and/or 
tour video clips 128. 

The viewer 102 is configured to display a 3D world 
associated with the data structure that is generated from a 
populated construction site. Objects and links associated 
with the data structure are displayed and/or executed within 
the 3D world. For example, a web link may be selected and 
loaded within the 3D world. 

In one embodiment, the data structure may include web 
links, and the viewer 102 communicates with a web browser 
130 using an intcr-process communication protocol, such as 
Component Object Model (COM). The viewer 102 may be 
configured to control any suitable browser, such as the 
Microsoft Internet Explorer. The browser is coupled to an 
internet cloud 131. \^ewer 102 may also interface with an 
HTTP server 138 that may be used to store web pages or 
other world data structures, for example. Alternatively, the 
viewer 102 may be configured to communicate with any 
other type of network. 

The viewer 102 may also interact with a communication 
server 104 that provides information about various objects 
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within a currently active 3D world. For example, the com- 
munication server may display the user's positions within a 
currently active 3D world. The viewer 102 may also have 
access to a user profile 140 that stores various user specific 
5 characteristics. For example, the user profile 140 may 
include selectable preferences for how the 3D worlds are 
displayed. 

The data structure 106 and associated information may 
then be used to generate a 3D world based on the informa- 

10 tion. The data structure 106 and associated information are 
associated with a construction site that is populated with 
specific objects and links. In general terms, the data structure 
106 includes references to objects (e.g. assets 108) and/or 
links (e.g. object links 120 or world links 121). These objects 

15 and/or links are associated with various locations of the 
construction site that correspond to locations within the 
associated 3D world. Thus, a 3D world may be efficiently 
generated from the data structure based on specific locations 
of the construction site and associated objects and links. 

20 Data Structure Embodiments 

As described above, a data structure is generated from a 
populated construction site. The populated constructions site 
includes a discrete set of sections or "tiles". In one 
embodiment, the construction site is a 16 by 16 array of tiles. 

25 Each of the tiles may be populated with one or more objects 
or links (hereinafter, referred to collectively as attribute 
instances). Additionally, one or more tiles may be subdi- 
vided into a plurality of positions and have attribute 
instances associated with any number of these positions. In 

30 general terms, the data structure is configured to associate 
each tile of the construction site with data for one or more 
attribute instances that are placed on the particular tile 
during population of the construaion site. 

FIG. 2 is a diagrammatic representation of the data 

35 structure 106 of FIG. 1 that may be used by the viewer 102 
to display a corresponding 3D world in accordance with one 
embodiment of the present invention. The data structure 106 
includes a plurality of attribute maps or layers 156, a 
plurality of descriptors 154, and a general data portion 150. 

40 Each attribute map is divided into a discrete set of 
locations or tiles, and the number of tiles corresponds to the 
number of tiles on the construction site. Each attribute map 
is also associated with a particular type or group of attribute 
instances. As shown, there is a attribute map for floor objects 

45 (205), wall objects (201), ceiling objects (203), sprite 
objects (207), MIDI sound objects (209), wave sound 
objects (211), video clip objects (213), links (215), blocking 
objects (21*^, wall height objects (219), click objects (220), 
and data structure entries (221). 

50 As shown, the attribute layers are conceptually layered 
over the construction site such that more than one attribute 
instance from different attribute layers may associated with 
a single location on the construction site. For example, the 
floor attribute layer 205 may associate a floor attribute 

55 instance with a particular tile, and the ceiling attribute map 
203 may associate a ceiling attribute instance with the same 
tile. 

Each attribute map is formatted such that a specific tile 
within the populated construction site is associated with 

60 specific identifiers. The identifiers correspond to the 
attribute instances that are used to populate the specific tiles. 
In one embodiment, the identifiers are in the form of 
numbers. For example, if five types of floor coverings (e.g., 
floor image objects) are used to populate the construction 

65 site, the floor attribute map 205 will contain five different 
identifier numbers. That is, any tile that contains a first type 
of floor covering will have a first identifier number (e.g.. 
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"1"), any tile that contains a second type of floor covering 
will have a second identifier number (e.g., "2"), etc. When 
a particular floor covering may cover several tiles of the 
construction site, the floor attribute map 205 will contain a 
plurality of "1" identifiers. That is, each tile that has the first 5 
type of floor covering will have a "1" identifier at the 
corresponding location in the floor attribute map. 

The descriptors 154 are formatted such that the identifiers 
are associated with specific attribute instances. In one 
embodiment, a descriptor will only contain identifiers for the 
attributes that were used to populate the associated attribute 
map. In the above example, since the floor attribute map 205 
contains five types of identifiers (five types of floor cover- 
ings were used to populate the construction site), the floor 
descriptor will have five different attribute instances that are 
associated with the five identifiers. In general, the descriptor 
may either contain or point to the data that constitutes its 
associated attribute instances. 

The general data portion 150 defines various characteris- 
tics of the 3D world that are not associated with a particular 
location within the 3D world. For example, the general data 20 
portion may describe how far a ceiling is from a floor within 
the 3D world. Several examples of the general data are 
described below in reference to FIG. 4. 

FIG. 3 is a diagrammatic representation of a particular 
location in the construction site and the location's associated 25 
identifiers and attribute instances in accordance with one 
embodiment of the present invention. As shown, the par- 
ticular location is indicated by a location identifier 302. By 
way of example, if the construction site is a 16 by 16 grid, 
the location identifier 302 may be in the form of [1,1], which 30 
location identifier corresponds to the top left comer of the 16 
by 16 grid. In contrast, the location identifier [16,16] cor- 
responds to the bottom right comer of the 16 by 16 grid. 

As shown, the particular location identifier 302 is asso- 
ciated with a plurality of attribute instance identifiers 304 35 
from different attribute layers. Consequently, several 
attribute instances may be associated with a particular 
location of the construction site. Said in another way, a 
plurality of identifiers from a plurality of attribute layers 
(e.g., 156 of FIG. 2) may be associated with a particular 40 
location of a construction site. In the embodiment shown, 
the identifiers 304 include a wall identifier, a ceiling 
identifier, a floor identifier, a sprite identifier, a MIDI 
identifier, a wave identifier, a video identifier, and a link 
identifier 45 

TTie identifiers may be in any suitable form for referenc- 
ing objects or links. In one embodiment, the identifiers are 
in the form of numbers that are each associated with a 
specific object or link within an associated descriptor. By 
way of specific example, if there are sixteen waU images 50 
within the associated descriptor, numbers 1 through 16 are 
used to identify the 16 different waU images. A waU iden- 
tifier equal to the mmiber 2 then corresponds to the second 
wall image within the associated descriptor. 

Identifiers may also be in the form of a predefined value, ss 
For example, a user may set particular identifier values that 
correspond to particular features of the resulting 3D world. 
By way of specific example, a waU height value may be 
selected, which value may correspond to an apparent height 
of a wall positioned on a particular location in the 3D world. 60 
Thxis, for a particular location a waU image wiU have a 
particular height value that is defined by the associated 
identifier. Any number of height values may be selectable. 
For example, a value between 0 and 255 may be used to 
select 256 different wall heights. 6S 

If the particular location 302 and associated identifier in 
a first 3D world has an associated link to a second 3D world. 



the particular location identifier may also have a correspond- 
ing entry point value within the second 3D world. That is, if 
the particular location in the first construction site is linked 
to a second populated construction site, an entry point may 
be defined on the second construction site. Thus, when one 
jumps from the first constmction site to the second con- 
struction site, they enter the second construction site at a 
location that is defined by the entry point value. 

The particular location identifier 302 may also be asso- 
ciated with a click type value that indicates how an associ- 
ated executable object or link is bandied when a user moves 
over the corresponding location or clicks on the correspond- 
ing location with an input device (e.g., a mouse or keyboard) 
within the 3D world. By way of example, a first chck type 
value may indicate that a link is only executed when the user 
moves over the particular location. In contrast, a second 
cUck type value may indicate that the link may also be 
executed when the user clicks on the corresponding location 
with the input device in the 3D world. 

FIG. 4 is a diagrammatic representation of the descriptors 
154 and the general data portion 150 of the data structiu'e of 
FIG. 2 in accordance with one embodiment of the present 
invention. As shown, the descriptors 154 include a wall 
descriptor, a ceiling descriptor, a floor descriptor, a sprite 
descriptor, a MIDI descriptor, a wave descriptor, a video clip 
descriptor, a link descriptor, and a background descriptor. 

The descriptors may reference attribute instances in any 
suitable manner. For example, as described above the 
descriptors may match identifiers within the attribute layer 
to specific attribute instance data. In one embodiment, an 
identifier may be matched to a starling address in a bitmap 
file that may include all of the images for a certain type of 
attribute instance. The particular bitmap file may include any 
number of images that may be used as data for different 
attribute instances. For instance, a wall bitmap file may 
include 16 different wall images, and mmibers 1 through 16 
are used as identifiers that reference the different wall 
images. 

The descriptor may be formatted to match identifiers of 
the associated attribute layer to specific starting addresses of 
particular images within the waU bit map file, for example. 
If the image size is known, the descriptor may merely 
include the starting address of the particular image within 
the bitmap file. If the image size is not Imown, the descriptor 
may include the end address, as well as the starting address, 
of the particular image within the bitmap file. 

The general data portion 150 of the data structiure 106 . 
includes various information that is used to generate and 
display the 3D world. For example, a defauh starting point 
within the 3D world may be included. When the 3D world 
is displayed in the viewer 102, the user wiU start at the 
default starting point if another starting point has not been 
defined. The starting point corresponds to a particular loca- 
tion in the construction site, as weU as the 3D world. 

Likewise, a default viewing height may be included 
within the general data portion 150. When the 3D world is 
generated and displayed, the user's perspective seems to be 
fi-om a particular viewing height with respect to the 3D 
world. For example, if the 3D world is in the form of a mall 
interior, a viewing height value may be set to a height that 
approximates head level so that the view appears "normal" 
to the user (e.g., the user appears to be viewing the 3D world 
fi'om head level). Alternatively, the user height may be set at 
a relatively high value and the user may appear to float 
through the air, high above the floor of the mall. 

Any number and type of user perspective values may be 
defined and/or set to defauh values within the generated data 
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Structure. These default user perfective values may then be 
changed prior to genera ting the data structure and/or after 
the 3D world is displayed. By way of example, a default 
angle may be defined in the general data portion 150. The 
default angle is defined as the direction the user appears to 
be looking within the 3D world. For example, a north, south, 
west, or east direction may be defined as the default angle. 
If the default angle is defined as the south direction, the user 
will appear to be looking towards the southern end of the 3D 
world. That is, even when the user is moving in another 
direction (e.g., in the northern direction), the user continues 
to look in the southern direction. 

A default speed may also be set that defines how fast the 
user appears to be traveling within the 3D world. As shown, 
the general data portion 150 also includes a ceiling flag and 
a ceiling height value. lo this embodiment, the ceiling flag 
is used to indicate whether a ceiling attribute instance is 
present in the construction site. If a ceiling attribute instance 
is present, the ceiling height value is used to define how high 
the ceiling appears in the viewer 102. 

The general data portion 150 may also include a back- 
ground flag and a color flag. The background flag is used to 
indicate whether the background descriptor references one 
or more predefined images that are used to generate the 
background of the 3D world. That is, the space behind the 
generated 3D objects in the 3D world may include a par- 
ticular background image, such as a "cloudy" sky image. 
The color flag is used to indicate whether the background 
descriptor references a particular color that is defined in an 
image file or defined by a particular color RGB value, for 
example. 

The general data portion 150 may also include a reference 
to a birdseye view map or 2D representation. The birdseye 
view is a 2D representation of the 3D world that may be 
generated and displayed along with the 3D world. An 
emblem image may also be referenced in the general data 
150. The emblem image indicates to which group the 
particular 3D world and associated data belongs. A back- 
ground position value may also be defined that indicates the 
background image's location with respect to the celling and 
floor. A background file flag may also be defined to indicate 
whether the background includes a plurality of dupUcated 
images. 

After a particular construction site has been populated 
with atbibute instances and general data has been defined 
and compiled into an associated data structure, a 3D world 
based on the data structure 106 may then be generated and 
displayed within the viewer 102. Several embodiments of 
the viewer are described in concurrently filed, co-pending 
U.S. Patent Application, having application Ser. No. 
09/183642, which is herein incorporated by reference in its 
entirety. 

Various objects within the 3D world correspond to 
attribute instances that were associated with the construction 
site and compiled within the associated data structure 106. 
For example, attribute instances that may be used to repre- 
sent the inside of a mall may be associated with the data 
structure 106, and thus, a 3D mall interior with associated 
3D structures .oaay be generated and displayed within the 
viewer 102. 

Viewer Embodiments for Displaying 3D Worlds 

FIG. 5 is a screen shot of a viewable portion of a 3D world 
that has been generated and displayed in the viewer 102 in 
accordance with one embodiment of the present invention. 
As shown, the viewer 102 includes a 3D world within a 3D 
viewport 502, a 2D representation from a birdseye perspec- 
tive of the data structure 106 in a 2D viewport 506, and an 
emblem image 504 that is used to group a plurality of 
worlds. 
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User preferences for how the 3D world is displayed and 
navigated through may be configurable using any suitable 
mechanisms. As shown, a speed button 510 is provided such 
that a user may switch between a plurality of different 

5 navigation speeds. This mechanism is similar to a gear shift 
in a car, for example. Of course, other types of mechanians 
may be provided for changing speeds, such as a value entry 
window that allows entry of a specific speed value. 
Another button provides access to a plurafity of definable 

10 settings 512 for controlling how the 3D world is displayed 
and navigated through. For example, an apparent height of 
the 3D world may be set via the setting 512. Several 
examples are described in concurrently filed, co-pending 
U,S, Patent Application, having application Ser. No. 09/183, 

15 642, which is herein incorporated by reference in its entirety. 
As described above, particular locations within the 3D 
world may be linked to other worlds or executable objects, 
such as URL sites or video clips. As a user travels between 
these different Knks and objects, mechanisms may be pro- 

20 vided for jumping back to previously traveled links or 
forward again to previously traveled links. For example, a 
user may travel from a first world to a second world to a third 
world. The user may then wish to travel back to the second 
world. Thus, a previous button 514 may be selected, and the 

25 user jumps back to the second world. The user may then 
wish to travel forward again (e.g. to the third world), and this 
may be accomplished by utilizing a next button 516. When 
a link is loaded by a web browser and the user travels from 
the first fink to other links via the web browser, the user may 

30 wish to jump all the way back to the 3D world that was 
displayed before the first link was loaded and displayed. 
Thus, an exit button 508 is provided to allow the user to 
travel all the way back to the 3D world from which the link 
was loaded. 

35 Various mechanisms for providing the above described 
features within the viewer 102 may be implemented. 
Additionally, several different mechanisms for the same 
particular feature may be implemented within the same 
display mechanism. For example, in addition to providing 

40 buttons for the user to navigate within the 3D world, access 
to pull down menus may also be provided with the click of 
a right mouse button or other similar mechanism. 
Builder Graphical User Interface Embodiments for Gener- 
ating 3D Worids 

45 Turning back to the builder side 100, the data structure 
106 used by the viewer 102 to display an associated 3D 
world may be generated by the builder 100. The data 
structure is compiled from an associated construction site 
that is populated and/or associated with a plurality of objects 

50 and/or hnks. In one embodiment, the builder 100 provides a 
graphical user interface 600 for populating and/or editing 
construction sites. In sum, each 3D world that is displayed 
within the viewer 102 is based on a populated construction 
site that was generated within a buUder 100. 

55 FIG. 6 is a screen shot of the builder 100 of FIG. 1 having 
a graphical user interface 600 for populating a particular 
construction site 601 and generating a 3D world based on the 
populated construction site 601 in accordance with one 
embodiment of the present invention. The same graphical 

60 user interface (GUI) 600 may also be used to modify an 
existing construction site. As shown, an unpopulated con- 
struction site 601 is displayed within the builder's GUI 600, 
The GUI 600 may also include any suitable mechanisms 
for selecting how the GUI is presented to the user as they 

65 populate the construction site. For example, as the user 
populates the construction site 601 with various objects 
and/or links, a separate display window (not shown) may 
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include the resulting 3D world. As shown, the GUI 600 
includes a "remote" button 602 that allows the user to select 
between displaying and updating the rcsuhing 3D world as 
the construction site is modified or not displaying the 3D 
world until a later time (e.g., after the populated construction 
site 610 is compiled). 

This remote button 602 featiu-e renders the 3D world "on 
the fly" while the construction site is being modified and 
allows the user to quickly assess the restilts of their work 
within the construction site 601. In one embodiment, a 3D 
world is updated when existing attribute instances are modi- 
fied in the construction site and not when attnbute instances 
are added to the construction site. In this case, a 3D world 
may be generated during compilation. Alternatively, the 3D 
may be updated when the associated construction site is 
altered in any way (e.g., when attribute instances are added). 

The GUI 600 may also include an "enlarge" button 604 
that selectably displays and hides a tool palette area 642 that 
allows selection of attributes for the construction site 601. 
When the tool palette 642 is hidden, the construction site 
601 is enlarged to fill the tool palette area 642 so that the user 
may more closely assess which objects and links have 
already been placed within the construction site 601. 
Similarly, a "zoom" button 606 is provided to allow the user 
to more closely inspect an object or link before placing it 
within the construction site 601. For example, after the 
"zoom" button 606 and a particular attribute instance are 
selected, an enlarged thumbnail image of the attribute 
instance is then di^layed. 

The GUI 600 may also include any suitable editing 
mechanisms for populating and modifying the construction 
site 601. As shown, the GUI 600 includes a plurality of tools 
608: a paint tool 610, an erase tool 612, an edit tool 614, and 
an attribute modification tool 616. When the paint tool 610 
is selected, the user may select objects and links and place 
them on the construction unit 601. In one embodiment, 
attribute instances (e.g. objects and links) may be placed 
onto the construction site 601 using a "painting" motion 
with the input device, e.g., a mouse. Of course, the attribute 
instances may be placed on the construction site in any 
suitable manner. For example, the attribute instances may be 
placed on the construction site one at a time. That is, a single 
attribute instance is placed within a single location within 
the construction site 601. 

Although the present invention is described as including 
the above described tools, of course, this list is merely 
illustrative and not meant to restrict the scope of the inven- 
tion. For example, the builder 100 may include a subset of 
the above described tools, additional tools, or any combi- 
nation thereof. By way of specific example, the builder 100 
may include a selection tool for allowing selection of a 
particular texture from a tile on the populated construction 
site 601. The selected texture may be applied onto other tiles 
of the construction site. 

When the erase tool 612 is selected, attribute instances 
may be selected and erased from the construction site 601. 
When the edit tool 614 is selected, attribute instances within 
the construction site may be rearranged. For example, an 
attribute instance may be moved or copied from a first 
location to a second location within the construction site 
601. When the attribute modification tool 615 is selected, the 
associated characteristics of a selected attribute instance 
may be modified for a particular tile within the construction 
site. For example, a height value for a particular object as 
represented within the 3D world may be selected and 
modified. Alternatively, an attribute instance may be modi- 
fied globally for all existing 3D worlds and/or for all 3D 
worlds that are created after any modification. 
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As attribute instances are added to the construction site 
601, the attribute instances are displayed within the con- 
struction site 601. Several different attribute instances may 
be layered on top of one another within the construction site 
5 601. As attribute instances are layered, it may be hard to 
distinguish between the different attribute instances in the 
construction site 601. Thus, the GUI 600 may provide a 
mechanism for displaying and hiding particular types of 
attribute instaiKes. 

As shown, the GUI 600 provides a plurahty of display 
buttons 618 for displaying or hiding a particular attribute 
layer. As shown, the display buttons 618 include a wave type 
sound button 632, a MIDI type sound button 622, a link 
button 624, and a blocking button 626. These types of 
attribute instances are further described below. Alternatively, 
a display button may be included for each attribute layer. 

Mechanisms may be provided within the GUI 600 for 
organizing the completed construction site 601. In other 
words, the completed construction site may be associated 
with other construction sites. As a result, a 3D world that is 
20 generated from the populated data structure will be associ- 
ated with other 3D worlds. Any suitable mechanism may be 
used for organizing the completed construction site and 
associated 3D world. As previously described, links may be 
placed within a construction site, and those links may be 
25 selected and loaded within the associated 3D world. 
Additionally, the populated construction site and corre- 
sponding 3D world may be associated with a hierarchical list 
of 3D worlds. 

In one embodiment, when the construction site 601 is 

30 completed, it may be added to the hierarchical list of worlds. 
As shown, an "add to world list" button 628 is provided 
within the GUI 600 to select a parent construction site (and 
associated world). By way of example, if the completed 
construction site is in the form of a mall, a previously 

35 existing construction site that is in the form of a particular 
city (e.g. Toronto) may be selected as the parent of the mall 
construction site. As shown, a "world" button 630 is also 
provided so the user may view the hierarchical list. 

In general terms, the GUI is configured such that the user 

40 may easily populate the construction site 601 with a plurality 
of attribute instances selected from an organized plurality of 
available attribute instances. The available attribute 
instances may be organized in any suitable manner such that 
the users may efficiently select the attribute instances and 

45 populate the construction site 601. 

The attribute instances (not shown) are grouped and 
displayed on separate palettes that are selectable by an 
associated tab 620. Each palette of attribute instances may 
form part of a conceptually separate attribute layer or map 

50 that may be placed on the construction site 601. For 
example, the attribute instances may be grouped according 
to their position within the resulting 3D world, such as part 
of a floor, wall, or ceiling palette. The attribute instances 
may also be grouped according to type, such as object links. 

55 As shown, the attribute instances are grouped into the 
following attribute layers: floors, walls, sprites, wave for- 
matted sounds, MIDI formatted sounds, tours, (object) Unks, 
borg (other data structure) links, blocking, and ceilings. 
Although the attributes (e.g., attribute instances and other 

60 user selectable information) are described as being grouped 
into separate tabs 620, of course, the attributes may be 
grouped in any suitable manner. For example, a single type 
of attribute may be grouped and spread among several 
different tabs 620. Additionally, a single tab may include 

65 more than one type of attribute. 

The tabs 620 may also include additional user selectable 
information, in addition to attribute instances. As shown, the 
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labs 620 include a "general tab" 620k that may be selected As shown, after the floor tab 620a is selected, a plurality of 

to display a general input window within the tool palette area floor type attribute instances 804 are displayed within a floor 

642. The general input window allows selection of general palette 842. The floor type attribute instances may take a 

characteristics of the 3D world that are not associated with wide variety of forms that in general represent flooring, 

particular locations within the construction site. Any suitable 5 ground, grotmd cover and other surfaces. For example, the 

mechanisms for allowing modifications to general charac- floor type attribute instances may represent carpeting, tiles, 

teristics may be implemented. For example, a plurality of concrete, rock, grass, shrubbery, rivers, ponds, pits, etc. 

general values 636 may be entered into the general input Particular floor type attribute instances may then be 

window. For example, a ceiling value, a speed value, a selected from the floor palette 842 and associated with 

direction value, and a height value may be selected by lo particular construction site location(s). For example, floor 

entering a value into the conresponding input boxes of the 804a or floor S04b may be selected and placed within the 

tool palette 642. construction site 601. The selected attribute instance may be 

Other general features may be selected by selecting a placed on one or more location within the construction site 

corresponding button. For example, a 3D world type (e.g. 601. That is, the construction site 601 is partitioned into a 

borg type) 634 may be selected. The world type 634 cat- is plurality of locations or sections 802, and each section or 

egorizes the construction site and corre^onding 3D world. location may be configured to receive a single selected 

As shown, a cyberscraper (an interior of a large building), a attribute instance of a particular type (e.g., attribute instance 

cyberhome (an interior of a small building), or a cypercity S04a from floor palette 842). 

(an exterior view with buildings) are provided for selection. FIG. 8B is a screen shot illustrating the construction site 

Different world types may have different associated default 20 601 of FIG. 8A after it has been populated with several 

characteristics, such as world height. An emblem image 638 different floor objects in accordance with one embodiment 

may also be selected within the general input window 642. of the present invention. Various types of floor objects may 

The selected emblem defines which group the particular 3D be placed within the construction site 601 to create a 

world belongs to. In this embodiment, the emblem image is desirable configuration of floor objects within the resulting 

selected by selecting the "change" button 640. 25 3D world. As shown, a ring of grass 810fl is placed around 

Turning to FIG. 7, an emblem dialog box 702 is shown. a block of marble floor 8106, and a red carpet path 810c cuts 

The emblem dialog box 702 is displayed when a user selects across the block of marble floor 8106. 

the change button 640 of FIG. 6. The emblem dialog box The attribute instance groups (e.g., palettes or attribute 

702 is in the form of a palette having a plurality of selectable layers) are extensible. In one embodiment, new attribute 

emblem images 704. A particular emblem image 704^ may 30 instances may be associated with one or more of the attribute 

be selected and used for a particular construction site. After layers or palettes. For example, one or more new floor 

the particular emblem 704fl is selected, the construction site textures may be added to the existing floor palette 842. That 

601 and associated 3D world may belong to a same group as is, floor image objects may be placed directly within the 

other construction sites and 3D workis that are associated floor palette window 812. Several mechanisms for adding to 

with the selected emblem image 704a. 35 an attribute layer or palette are described below in reference 

Returning to FIG. 6, the general input window 642 may to FIGS. 34 and 35. 

also provide a mechanism for selecting a background for As described above, attribute instances may be layered on 

displaying within the 3D world. Any suitable type of back- a particular location within the construction site 601. FIG. 

ground may be used and displayed behind and around the 9A is a screen shot illustrating the construction site 601 of 

displayed objects in the 3D world. As shown, the back- 40 FIG. 8B after it has been populated with several different 

ground may include an image, which is selected by an types ofwall objects in accordance with one embodiment of 

"image" button 650, or a sotid color, which is selected by a the present invention. To layer attribute instances, another 

"color" button 652. After either the image button 650 or the palette or group of attribute instances may be seleaed from 

color button 652 is selected, the particular palette of images the tabs 620. As shown, a wall tab 6206 is selected such that 

or colors may be displayed by pressing the change button 45 a palette of waU images 942 is displayed. The wall palette 

654. A particular image or color may then be selected firom 942 includes a plurality ofwall type attribute instances 904. 

the displayed palette. The waU attribute instances 904 generally represent verti- 

Besides providing selectable general characteristics, the cally oriented objects that may be displayed as 3D objects 

builder 100 also provides mechanisms for populating the within the 3D world. In the context of a mall, the waUs may 

construction site 601 with selected attribute instances. Any 50 take the form of interior and exterior building walls and/or 

suitable mechanisms may be provided for selecting a par- room wall structures, doors to various shops within the mall, 

ticular attribute instance and associating it with one or more columns, windows, an exit that includes a view to other 

locations of the construction site 601. In one embodiment, buildings outside of the mall, or a stairway within the mall, 

the attribute instances are painted onto the construction site More generally, a wide variety of other vertical structures 

601. Painting may be initiated by selecting the paint tool 55 may be defined as wall images as well. By way of example, 

610, selecting a particular attribute instance tab 620, and the wall attribute instances 904 may include a clock tower 

selecting a particular attribute instance 804 from a palette 904a, other buildings, trees, towers, poles, walls, fences, etc. 

that appears in response to the selection of the associated Attribute instances 904 may be selected firom the palette 

tab. One or more locations within the construction site 601 942 and associated with one or more locations within the 

may then be selected for associating with the selected 60 construction site 601. As shown, the construction site 601 

attribute instance, and the selected attribute instance is includes a first type of attribute instance 902a that is placed 

"painted" onto the construction site. on a pluratity of construction site location. The construction 

When a particular attribute instance tab is selected, a site 601 also includes a second type of attribute instance 

corresponding palette of attribute instances is displayed in 9026 that is also placed on a number of different locations 

the attribute display window 642. FIG. 8A is a screen shot 65 within the construction site 601. 

illustrating selection of the floor tab 620a of FIG. 6 in When ±ese wall attribute instances 902a and 9026 are 

accordance with one embodiment of the present invention. used to generate the 3D world, wall images associated with 
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the attribute instance are used to generate 3D objects within 
the 3D world. Any suitable mechanism may be used to 
generate a 3D object within the 3D world. For example, a 
single wall image may be used to generate each side of a 
particular building. That is, a single wall image is duplicated 5 
four times, for example, for each wall of a four sided 
building. 

This method allows efficient generation of 3D objects 
from 2D images. In contrast to a virtual reality modeling 
language (VRML), which uses complicated algorithms to 10 
generate a 3D object, a 3D objea may be generated by 
stitching 2D images together to simulate the 3D object. In 
other words, calculations for generating the shape of a 3D 
object are minimized. 

The GUI 600 may also include mechanisms for modifying 15 
a particular attribute instance's characteristics. For example, 
a wall height may be altered for a particular wall attribute 
instance. FIG. 9B is a screen shot showing a dialog box for 
modifying characteristics of a particular wall object of FIG. 
9A in accordance with one embodiment of the present 20 
invention. The dialog box 950 is displayed after selecting the 
attribute modification tool 616 and then selecting a particu- 
lar attribute instance to be modified from the construction 
site 601 or the palette display window 642. If the dialog box 
is accessed from the construction site, then the modification 25 
will only be applied locally to the selected attribute instances 
for the construction site. Alternatively, if the dialog box is 
accessed from the palette display window 642, the modifi- 
cation is applied globally to all subsequently created 
attribute instances. Alternatively, the modification may be 30 
applied to all existing, as well as subsequently created, 
attribute instances. 

The dialog box 950 for modifying the selected attribute 
instance's characteristics may have any suitable form. As 
shown, the dialog box 950 includes a visual representation 35 
954 of the particular attribute instance. The dialog box 950 
includes a lever 952 that is slidably movable. A position of 
the lever 952 corresponds to a particular height for the 
selected attribute instance. As the user moves the lever 952 
to different height values, the height of the image represen- 40 
tation 954 in the dialog box 950 correspondingly changes. 

If the sprite tab 620c is selected, sprite objects are 
displayed within the attributes instance window 642. As 
shown in FIG. lOA, a plurality of sprites 904 are displayed 
within the palette 1042. A sprite object may include trans- 45 
parent portions that allow other objects on the tile to be 
visible within the 3D world. For example, a column of space 
within the 3D world may include a sprite object in the form 
of a statue that is positioned over a particular floor covering, 
such as a marble floor. Any portion of the marble floor that 50 
is not covered by the sprite object is visible and displayed 
within the 3D world. Likewise, a background image may be 
visible and displayed around the edges of the sprite object 
and within the associated column of space. 

A sprite object may be in the form of a multi-sided 3D 55 
object, an animatible 3D object, or an animatible 2D object 
displayed on a 3D wall object By way of examples, a sprite 
object be in the form of a multi-sided 3D free-standing 
person, a rotating statue, and a video-formatted billboard 
displayed on a wall of a building within the 3D world. 60 

In one embodiment, a sprite object may be configured to 
be displayed at multiple angles within an associated 3D 
world. That is, a sprite object may include a plurality of 
frames that are sequentially displayed as a user walks around 
the sprite object in the associated 3D world. These frames 65 
may correspond to dififerent sides of the same object so that 
different frames are seen from different viewing angles. Id 
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Other words, a different frame may be used for each side of 
the object to simulate a multi-sided 3D object. The side or 
frame that is di^layed depends on the viewing angle 
relative to the object. For example, if a sprite object has four 
sides, then a first frame may be displayed for the eastern side 
of the object, a second frame for the western side, a third 
frame for the southern side, and a fourth frame for the 
northern side. Of course, the nimaber of frames may be 
increased (and thus the angle between frames decreased) to 
improve the visual experience. 

Alternatively, the sprite object may be a rotating object 
within the 3D world. In this configuration, each frame of the 
sprite object is sequentially displayed to give the appearance 
(from the standpoint of a static viewer) that the sprite object 
is rotating. In yet another embodiment, the sprite object is 
animated. In this embodiment, a series of images arc dis- 
played from a particular viewing angle to give the appear- 
ance of animation (e.g., a billboard that appears in the form 
of a video clip) Of course, the sprite object may have only 
a single frame that is displayed for all viewing angles. In this 
case, a single side will always appear to face the user as she 
"walks" around the sprite object 

In one embodiment ^ sprite object may be placed on a 
location of the construction site 601 that may also include 
other objects, such as a floor object or a wall object. If a 
sprite object is placed on the same location as a wall object, 
the sprite object may be rendered on a particular side of the 
wall object in the 3D world. For example, a sprite object that 
is in the form of an advertisement sign may be placed on the 
side of a wall object that is in the form of a building. In 
contrast if that same advertisement sprite is placed on a 
location that does not include a wall object advertise- 
ment sprite takes the form of a free-standing 3D object 
within the 3D world. 

Each sprite object may include several modifiable char- 
acteristics. Thus, the GUI 600 include mechanisms for 
modifying the characteristics of the ^rite objea. Turning to 
FIG. lOB, by selecting the attribute modification tool 616 
and a particular sprite object a sprite dialog box 1050 may 
be displayed that is configured to receive a user's input, e.g., 
through a pointer or keyboard. 

The sprite dialog box 1050 may allow modification of any 
suitable characteristics of a particular sprite object As 
shown, the dialog box 1050 allows selection of a particular 
face of the associated wall object upon which to display the 
sprite object. That is, when the sprite object is placed on a 
location of the construction site 601 that also has a wall 
object, the ^rite object may appear on a north face, a south 
face, a east face, and/or a west face of the wall object. The 
sprite object may be configured to be rotatable, multi-sided, 
continuously rotatable, and/or rotatable on activation (as for 
example by tapping or clicking on the sprite object). 

The sprite image may have any suitable format for 
creating a sprite object. In one embodiment the sprite image 
is composed of a long vertical strip of cells, one after the 
other. The "cell width" may always be fixed to correspond 
to the width of the image. The "cell height" may be 
configurable within the dialog box 1050. In this 
embodiment the number of cells is proportional to the cell 
height That is. the cell height is equal to the total image 
height divided by the number of cells. 

The "default duration" is the time that passes between 
when a current frame's display ends and another frame 
display begins. The default duration may be modified within 
the dialog box 1050. Any suitable range of values may be 
allowed. By way of example, a value between about 33 and 
10,000 may be translated into an actual range of about thirty 
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frames per second to one frame every ten seconds. Of 
course, the sprite object may not be animatible, and the 
default duration value is then disregarded. 

The "frame number" indicates which cell is displayed in 
the dialog box 1050. A change to this value causes the 5 
appropriate frame to be displayed within the dialog box 
1050. The right and left arrow buttons increment or decre- 
ment the currently displayed frame number. The "frame 
duration" is the length of time that the current frame will be 
displayed in an animated sprite object. This value may 10 
override the default duration, and may have no effect if the 
sprite object is not an animated object. 

The "sides per rotation** entry specifies the number of 
frames that constitute a complete animatioa cycle. A default 
value may be set that is equal to the total number of cells in IS 
the sprite object, for example. The "repeat count" value may 
be used to modify the number of cycles to animate in cases 
where the sprite animation does not repeat infinitely. For 
example, a value of 1 indicates that one animation cycle will 
be displayed, and a value of 2 indicates that two animation 20 
cycles will be displayed. A zero value may be defined to 
indicate that the animation will continuously cycle. 

The "world height" and "world width" values may be 
modified in the dialog box 1050 to change the apparent size 
of the 3D world so that it appears stretched or shrunk. The 25 
"tile X" and "tile Y" parameters may be modified to alter a 
position of the center of the sprite object with respect to the 
location in the construction site. In one embodiment, the 
construction site is divided into a 16 by 16 array of tiles, and 
each tile is divided into a 256 by 256 array of locations. A 30 
sprite object may be placed on a particular tile and on a 
particular location within such tile. In this case, each tile 
value may by set to a value between 0 and 255. A value of 
"0,0** represents the lower left hand comer of the particular 
location in the construction site 601. 35 

The "sprite height" value may be modifiable and corre- 
sponds to the height of the sprite object as it appears with 
respect to the floor in the 3D world. For example, the height 
value may correspond to how high the sprite object appears 
above the floor image within the 3D world. 40 

A "rotatable" selection button indicates that the sprite 
object may be animated. The "multi-sided** selection button 
indicates ihzi the sprite object may display a different frame 
when viewed from different angles. The "rotate always" 
selection button indicates that the animation can not be 45 
terminated from within the 3D world. The "rotate on load- 
ing** button indicates that the sprite object is animated as 
soon as it is loaded, e.g., when the 3D world is rendered. 

Attribute instances may be in the form of sound objects, 
as well as image objects. The sound objects may include any 50 
suitable type of sound objects and may be grouped in any 
suitable manner. The sound objects may be blendable or 
nonblendable within the 3D world. In one embodiment, the 
sound objects are divided by types of sound format onto 
separate palettes. A selection of sound tab 120^ displays a S5 
palette of wave type sound objects (not shown). As shown 
in FIG. 11,. selection of .MIDI tab 620e displays a palette 
1142 of MIDI type sound objects 1104, Of course, other 
types of sound objects may be grouped on other tabs or 
grouped on the same tab as either the wave sound objects or 60 
the MIDI sound objects. 

A particular sound object (e.g., 1104) may be selected and 
placed on a particular location (e.g., 1106) on the construc- 
tion site 601. Each type of sound object may be represented 
by a different a type of icon on the construction site 601. As 6S 
shown, a musical note 1106 is used to represent a MIDI 
object, and a speaker 1108 is used to represent a wave object. 
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Selection of the MIDI display button 632 displays or 
hides the wave sound objects on the construction site 601. 
The MIDI display button 622 may likewise be used to 
display the MIDI sound object on the construction site 601. 
This feature reduces clutter within the construction site 601 
when it*s populated with a relatively large nximber of 
attributes instances. 

The attribute instances may also be in the form of a link 
to another object. In practice, the links can be made to any 
object that is recognizable by the current operating system 
and/or the viewer application. By way of one example, if the 
Microsoft Windows Operating System is used, the object 
may be any object that is executable by any Microsoft 
Windows application. By way of another example, a link 
may be a URL address to a particular web page or site, an 
Excel document that is executed by Microsoft Excel, or a 
plain bitmap file that is executed by Microsoft Paint pro- 
gram. 

As shown in FIG. 12, a plurality of links are displayed 
within the palette 1242 by selecting the link tab 620/. The 
palette 1242 includes a URL web link 1202^z to a Compaq 
computer site and a drawing document link 12026. Selection 
of the link di^lay button 624 displays or hides links within 
the construction site 601. When the links 1204 are displayed 
in the construction site 601, any suitable icon may be used 
to represent the link. In the embodiment shown, a lightening 
symbol is used to represent the links 1204 within the 
construction site 601. Alternatively, more than one icon type 
may be used to represent and differentiate various types of 
links. 

In the described embodiment, the links may be activated 
in a variety of ways. For example, some links may be 
activated by simply passing over fliem in the viewer, while 
others may require the user to affirm alively select (as for 
example "clicV* on) the link. The characteristics of a par- 
ticular link on the construction site 601 may be modified by 
selecting the attribute modification button 616 and the link 
of interest. When the attribute modification button 616 and 
a particular link are both selected, a link dialog box 1250 (as 
shown in FIG. 12) is displayed. In one embodiment, a click 
option may be selected for the particular link. When the click 
option is selected, a click on the link within the 3D world 
(e.g., the user may click on the link with a mouse) results in 
activation of the particular link. For example, a particular 
web site may be loaded by the viewer 102. In contrast, when 
the click option is not selected, the link is activated when the 
user simply moves over the particular location on the 
construction site that includes the link. 

One or more locations on the construction site 601 and the 
associated 3D world may be configured to be associated 
with links to other 3D worlds. In other words, when the 
populated construction sites 601 is compiled into a data 
structure, this data structure may include links to other 3D 
worlds. In this embodiment, 3D worlds are in the form of 
manageably sized and size-delimited 3D worlds that may be 
infinitely linked with other similarly sized 3D worlds. This 
feature provides a relatively high level of flexibility in 
managing and organizing 3D worlds. 

As shown in FIG. 13, a plurality of links 1302 to other 3D 
worlds are displayed within a palette 1342 when the "Borg 
link" tab 620^ is selected. A link dialog box 1350 may be 
displayed when the attributes modification button 616 and a 
particular attribute instance are selected. The dialog box 
1350 allows selection of an entry point within the 3D world 
that is referenced by the construction site currently being 
populated. In other words, when the current construction site 
601 and corresponding objects and links are rendered into a 
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3D world, a particular location within the 3D world will be 
linked to another 3D world that may be selected and 
rendered. 

Movement within the 3D world may be Umited by placing 
blocking attribute instances 1402 within the construction site 
601, As shown in FIG. 14, a blocking tab 62Qh displays a 
blocking attribute instance 1402 within the palette 1442. 
This blocking attribute instance 1402 may be placed at one 
or more locations within the construction site 601. When a 
3D world is generated from the construction site and cor- 
responding dbjcci and links, movement is prohibited within 
the locations containing a blocking attribute instance 1402. 
The palette 1442 may include more than one type of 
blocking attribute instance. For example, a blocking 
attribute instance may prohibit particular kinds of 
movement, such as entering or exiting a location from a 
particular direction. Selection of the blocking display button 
618 displays or hides blocking attributes instances on the 
construction site 601. 

Referring to FIG. 15, ceiling type attributes instances 
1502 may also be displayed within a palette 1542 by 
selecting the ceiUng tab 620i. Ceiling attribute instances 
1502 may then be selected and placed or painted within the 
construction site 601. Ceiling attribute instances may take 
any suitable form within the 3D world. For example, ceil- 
ings may be in the form of different materials, such as tile, 
stucco, or glass. Ceilings may also take the form of various 
ceiling structures, such as chandeliers or skyUghts. 

One or more tours may be defined within the populated 
construction site 601. A tour is defined as an automated path 
on which a user is taken within the 3D world. Along the path, 
various events occur. For example, specific sounds may be 
played or stopped at specific locations along the path; 
executable objects may be initiated at various points along 
the path; or various executable objects may be halted at 
various points along the path. As a user travels along a 
predefined tour route, the user may still interact with por- 
tions of the 3D world. For example, when a user moves over 
a location that contains a link, the link is activated. 

Referring to FIG. 16, when the tour tab 620j is selected, 
a tour input box 1642 is displayed for the currently selected 
location on the construction site 601. In one embodiment, 
music and/or a video clip may be selected, initiated, and/or 
terminated for the selected location. Additionally, a view 
direction and a speed may be selected for the user. Various 
locations on the construction site 601 may be modified to 
include events that arc programmed via the tour input box 
1642. Various programmed events on various associated 
locations are then linked together into a tour path 1604. As 
shown, the construction site 601 includes a tour path 1604 
with a plurahty of events 1606. 

After a particular construction site has been built using the 
facilities described above, the builder data is compiled into 
a data structure that is usable by the viewer 102 of FIG. 1 to 
rendered the 3D world that has been created. FIG. 17 is a 
screen shot of a portion of a 3D world rendered from the 
populated construction site of FIG. 15 in accordance with 
one embodiment of the present invention. 

The various objects and links on the construction site 601 
are each rendered as 3D visible objects or executable objects 
and/or links within the 3D world. For example, the floor 
objects on the construction site are rendered as floor portions 
1702 within the 3D world. Different types of floor objects 
may be rendered differently within the 3D world. For 
instance, a first type may be rendered as a carpet portion and 
a second type may be rendered as a brick sidewalk portion. 

Similarly, different types of wall objects may be rendered 
as different wall objects or portions within the 3D world. As 
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shown, a first wall object 1704^2 is in the form of an exit to 
the outside of a building. A second wall object 17046 is in 
the fonm of an interior wall face having a plurality of 
windows 1704c. A third wall object llMd is in the form of 
5 a column structure. Different types of ceiling objects may 
also be rendered as different ceiling portions 1706 within the 
3D world. 

Different types of sprite objects may be rendered differ- 
ently within tlie associated 3D world. ITiat is, different sprite 

10 objects may be rendered as visually different 3D objects 
within the associated 3D world. Additionally, a particular 
sprite attribute instance may be displayed differently within 
the 3D world. For example, the sprite objects behavior may 
depend on where it is placed within the 3D world. As shown, 

15 a first sprite object 1710a is in the form of a sign that is 
displayed on a wall object 17046. If that same first sprite 
object 1710fl is placed at a location without a wall object, it 
is displayed as a stand-alone 3D object As shown, a second 
sprite object 17106 is in the form of a person standing within 

20 the 3D world. 

Particular locations within the 3D world and each of the 
visually rendered 3D objects (e.g., floors, walls, sprites, and 
ceilings) may also have associated executable objects, such 
as sound objects. That is, as one travels within the 3D world, 

25 sounds are played as a user passes over a particular location 
within the 3D world. Likewise, some visually rendered 
objects may also be associated with an executable object, 
such as a video clip or a URL site. In the case of the URL 
site, the corre^onding web page is loaded. 

30 The present invention may provide a useful metaphor for 
organizing various executable objects and links. By way of 
example, URL sites may be organized in a famihar way. By 
way of specific example, a 3D mall interior may be built, and 
each shop within the mall may be associated with a corre- 

35 sponding URL address. A pet shop may be associated with 
a particular pet company URL address that allows the user 
to order pet supplies. 

The populated construction sites and corresponding 3D 
worlds may also be Unked together in logical super- 

40 constructs. For example, the 3D pet store may include a hnk 
to another 3D world in the form of a book store that 
specializes in aoinaal subject matter The specialized book 
store may include 3D books that are, in turn, linked to texts 
objects that suimmarize particular books to help a customer 

45 make a selection and purchase. 

The 3D world is rendered from a compiled data structure 
that is associated with a populated construction site and its 
associated objects and/or links. The populated construction 
site is compiled within the builder 100. FIG. 18 is a screen 

50 shot of a tool bar 1800 within the builder 100 of FIGS. 6 
through 17 in accordance with one embodiment of the 
present invention. The tool bar 1800 includes standard pull 
down menus (not shown) for standard file management 
functions, such as "open file" and "save file." Additionally, 

55 the tool bar 1800 includes features that are specific to the 
present invention. For example, the tool bar 1800 includes a 
pull down menu for compiling the populated construction 
site and testing the resulting 3D world. 

Before the constmction site may be compiled, it is popu- 

60 lated and/or associated with one or more objects and/or 
links. As described above, the builder 100 provides a graphi- 
cal user interface for populating constructions sites. As a 
particular construction site is being populated, data associ- 
ated with modifications or additions to the construction site 

65 is stored for use in the corresponding data structure. For 
example, data may be stared until it is compiled into a data 
structure. Altematively, data may be stored within the data 
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Structure as the construction site is being populated. Any 
suitable mechanisms may be implemented for creating the 
data structure. 

Builder Mechanism Embodiments for Generating 3D 
Worlds 

FIG. 19 is a flowchart illustrating a process 1900 for 
populating or modifying a construction site in accordance 
with one embodiment of the present invention, A new 
construction site is substantiated in operation 1901, or an 
existing construction site is opened in operation 1911. If an 
new construction site is substantiated, several parameters 
may be set to default values that define certain aspects of the 
rendered 3D world. For example, a height for the 3D world 
may be set to a default height value. 

General data is then modified and/or generated in opera- 
tion 1903. General data inchides data that is not associated 
with a particular location within the populated construction 
site. After the general data is generated, the attribute maps 
are populated or modified in operation 1905. In general 
terms, the attribute maps are populated by placing selected 
attribute instances onto the construction site. Operation 1905 
is further described below in reference to FIGS. 20 through 
24. 

Tours may then be created or modified in operation 1907. 
A data structure based on the populated attribute maps, 
general data, and tour data is then compiled in operation 
1909. The compiled data structure will include, for example, 
references to attribute instances and/or tour data that were 
associated with the construction site. Operation 1909 is 
further described below as reference to FIGS. 25 through 33. 

FIG. 20 is a flowchart illustrating the operation 1905 of 
FIG. 19 of populating or editing the attribute maps in 
accordance with one embodiment of a present invention. 
Initially, an attribute map is selected in operation 2001. For 
example, a particular tab 620 of the GUI may be selected so 
that associated attribute instances are displayed within the 
attribute display window 642. 

A tool 610 may then be selected in operation 2004. Of 
course, a default tool selection value may aheady be set and 
this step is not required. In one embodiment, the default tool 
is the paint tool 610. Other tools that may be selected are the 
erase tool 612, the edit tool 614, or the attribute modification 
tool 616. 

In operations 2006 through 2012 it is determined whether 
the paint tool, the erase tool, the edit tool, or the attribute 
modification tool has been selected. If the paint tool has been 
selected, a paint operation is performed in operation 2007. If 
the erase tool is selected, an erase operation is performed in 
operation 2009. If the edit tool is selected, an edit operation 
is performed in operation 2011. If the attribute modification 
tool is selected, an attribute modification operation is per- 
formed in operation 2013. 

It is then determined whether there are more edits to 
perform within another attribute map in operation 2016. If 
there are no more edits, the process 1905 ends. If there are 
more edits, the process 1905 returns to operation 2001, and 
a new attribute map is selected. . . 

FIG. 21 is a flowchart illustrating the operation 2007 of 
FIG. 20 for performing a paint operation in accordance with 
one embodiment of the present invention. Initially, an 
attribute instance is selected in operation 2102. In one 
embodiment, the attribute instance is selected from a palette 
that is displayed within the attribute instance display win- 
dow 642. One or more locations or tiles are then selected 
using a paint technique in operation 2104. 

The selected attribute instance is then applied to the 
selected tiles in operation 2106. It is then determined 
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whether the selected attribute instance is to be placed on 
more locations within the construction sites in operations 
2108. If more locations are to be selected, operations 2104 
and 2106 are repeated, and more locations are selected, and 
5 the selected attribute instance is applied to the selected 
locations. 

If the selected attribute instance is not to be applied to 
more tiles, it is then determined whether a new attribute 
instance is to be selected within this attribute layer in 

10 operation 2110. If a new attribute instance is desired, a new 
attribute instances is selected in operation 2007, and it is 
appUed to selected locations in operations 2104 and 2106. 

When no more attribute instances are to be selected from 
the current attribute layer and applied to the construction site 

15 using the selected tool, it is determined whether another tool 
selection is desired in operation 2112. If another tool is to be 
selected, the process 2007 returns to operation 2004 of FIG. 
20 and another tool is selected. If another tool is not to be 
selected, the process 2007 then returns to operations 2016 of 

20 FIG. 20, where it is determined whether another attribute 
layer will be selected. 

FIG. 22 is a flowchart illustrating operation 2009 of FIG. 
20 for performing an erase operation in accordance with one 
embodiment of the present invention. Locations within the 

25 construction site are selected using a paint technique in 
operation 2202 such that attribute instances associated with 
the selected attribute layer on the selected locations are then 
erased in operation 2204. It is then determined whether more 
attribute instances associated with the selected attribute 

30 layer are to be selected and erased in operation 2206. 

If more attribute instances are to be erased, more locations 
are selected for erasure in operation 2202. If it is determined, 
however, that no more locations are to be erased, it is then 
determined whether any other tool will be applied to the 

35 currently selected attribute layer in operation 2208. If it is 
determined that another tool will be applied, the process 
2009 proceeds to operation 2004 of FIG. 20, where another 
tool is selected. 1^ however, it is determined that other tools 
are not to be apphed to this attribute layer, the process 2009 

40 proceeds to operation 2016 of FIG. 20. In operation 2016, it 
is determined whether additional edits will be performed on 
the construction site (e.g., by selecting another attribute 
layer). 

FIG. 23 is a flowchart illustrating the operation 2106 of 

45 FIG. 21 for applying the selected attribute instance to the 
selected location(s) in the construction site. Initially, it is 
determined whether the selected attribute instance is iden- 
tified in the descriptor for the selected attribute layer in 
operation 2302. If it is not identified, the selected attribute 

50 instance is added to the descriptor for the selected attribute 
layer in operation 2304. 

However, if the attribute instance is identified in the 
descriptor, an identifier associated with the selected attribute 
instance is obtained finom the descriptor in operation 2308. 

55 After the identifier is either obtained from the descriptor or 
newly assigned to the selected attribute instance, the iden- 
tifier is then placed within the attribute layer cell(s) that 
correspond to the selected location(s) in operation 2310. The 
process 2106 then ends. 

60 FIG. 24 is a flowchart illustrating operation 2013 of FIG. 
20 of performing an attribute modification operation in 
accordance with one embodiment of the present invention. 
Initially, a particular location in the construction site 601 is 
selected in operation 2401. An identifier for the attribute 

65 instance that is on the selected location is then obtained from 
a cell of the selected attribute layer maps that corresponds to 
the selected location in operation 2402. The attribute 
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instance's oame is then obtained from the descriptor based 
on the obtained identifier in operation 2406. 

Data is then obtained for the selected location using the 
attribute layer map and descriptor information in operation 
2408. Data may be in any suitable format. For example, the 
data may be an actual data value or a reference to other data 
values located outside of the descriptor. After data is 
obtained for the selected location, a dialog box is then 
displayed for editing the attribute characteristics in operation 
2410. Editing input data (e.g., a size value for the selected 
attribute instance) is then received in operation 2412. The 
received input data is then stored in operation 2414. The 
process 2013 thea proceeds to operation 2016 of FIG. 20, 
where it is determined whether any more edits are to be 
performed on the construction site 601. 

FIG. 25 a flowchart illustrating the operation 1909 of FIG. 
19 of compiling a completed construction site 601 in accor- 
dance with one embodiment of the present invention. 
Initially, image data is processed in operation 5000. The 
image data includes any type of image object. In one 
embodiment, the image data includes floor images, wall 
images, sprite objects, ceiling objects, background images, 
an emblem image, and a birdseye view image. Image data 
may include image objects that are di^layed at a particular 
location within the 3D world or image objects that are 
displayed elsewhere within the viewer 102. 

Non-image data is then processed in operation 5100. In 
one embodiment non-image data includes sound objects, 
video clips, object links, and any type of executable object. 
Each object or link may be associated with a particular 
location on the construction site 601 or may be in the form 
of general data that is associated with the entire 3D world. 

The processed image data and oon-image data is then 
compiled into a data sUiicture in operation 5200. The data 
structure is organized such that e£5cient rendering may take 
place based on information within the data structure. Com- 
pilation of the data structure is further described below in 
reference to FIG. 33. Once the data structure is compiled, it 
is transferred to a repository, along with any associated files, 
in operation 5300. The repository may be any suitable 
storage medium located at any suitable location. For 
example, the repository may be located on the local hard 
drive, a local server, or on an external server. After the data 
structure is transferred, the process 1909 for compiling the 
data structure then ends. 

FIG. 26 is a flowchart illustrating the operation 5000 of 
FIG. 25 of processing image data in accordance with one 
embodiment of the present invention. Initially, image layers 
or attribute layers are processed in operation 5010. In 
general terms, the descriptors (e.g., 154 of FIG. 2) are 
generated or modified based on the results from processing 
the image layers. 

A birdseye view image or 2D image is then generated in 
operation 5600. The 2D image is a 2D representation of the 
3D representation or world from a particular perspective 
(e.g., from a birdseye perspective). The birdseye view may 
be output for use by the viewer. lj>2. For example, a birdseye 
view image file may be referenced by the data structure for 
the populated construction site, and the birdseye image file 
will be used to generate the 2D representation in the viewer 
102. Alternatively, the viewer 102 may generate the birdseye 
view. 

Single images are then validated in operation 5060. Single 
images may include, for example, the emblem, the birdseye 
view maps, and the background. For example, single images 
are the images that are not specifically tied to a location 
within the construction site 601. Validation of the single 
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images include any suitable validation techniques for veri- 
fying whether the single images may be accepted by the 
viewer. For example, validation may include determining 
whether a selected emblem image is accessible. 

5 One or more color palettes may then be constructed for 
the image files in operation 5080. In general terms, a custom 
palette of colors is generated for one or more of the images 
such that an optimal set of colors that are to be used within 
the image are defined within the palette(s). Construction of 
the palettes is further described below in reference to FIG. 
30. After the color palette(s) are constructed, processing of 
the image data is complete. 

FIG. 27 is a flowchart illustrating the process 5010 of FIG. 
26 of processing image layers in accordance with one 
embodiment of the present invention. Initially, a first 

15 attribute layer is obtained in operation 5012. By way of 
example, a floor layer may be obtained. 

A builder layer table and attribute map are then updated 
in operation 5014. The builder layer table is analogous to the 
descriptor for the same layer and matches identifiers within 

20 the attribute map to attribute instances (e.g., objects and/or 
links). Updating of the layer table and attribute maps are 
further described below in reference to HG. 28. 

A descriptor associated with the obtained attribute layer is 
then initiaUzed in operation 5016. The descriptor may 

25 include additional information that is not included within the 
attribute layer table. For example, the layer table may 
contain names to aU of the individual image fiiles, while the 
descriptor contains references to different images within a 
single compiled image file. In other words, the layer table 

30 and the descriptor are both configured to store references to 
objects and/or links that are implemented on the current 
construction site 601. 

After the descriptor is initialized, it is determined whether 
a composite image will be created from a plurality of layer 

35 images in operation 5018. In other words, it is determined 
whether a plurality of images will be stored in a single 
composite image file. By way of example, a floor layer may 
include three different types of floor images: a marble floor, 
a brick floor, and a slate floor. The three different floor 

40 images may be stored contiguously within the same com- 
posite image file. 

If a composite image is to be created, a composite image 
file is initialized in operation 5022. A first image name is 
then obtained from the layer table in operation 5023. The 

45 image file associated with the image name is then validated 
in operation 5024. The image for the particular location 
witMn the construction site is copied into the composite 
image in operation 5028. A position of this first image within 
the composite image is then stored within the descriptor in 

50 operation 5020. It is then determined whether there are more 
images for the current layer in operation 5032. 

The remaining names for the remaining images are then 
obtained firom the layer table in operation 5023. The asso- 
ciated image files are then validated in operation 5024, and 

55 stored within the composite image in operation 5028. The 
positions of the images are each stored within the descriptor 
in operation 5030. 

It is then determined whether any more layers arc to be 
processed in operation 5034. If no more layers are to be 

60 processed, the operation 5010 ends. However, if there are 
more layers, the process 5010 is repeated at operation 5012. 

If a composite image is not going to be created for a 
particular attribute layer, a first image name is obtained firom 
the builder layer table in operation 5036. An image file 

65 associated with the image name is then validated in opera- 
tion 5027. This image name is then stored within the 
descriptor in operation 5038. 
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It is then determined whether there are any more image 
for the oirrent attribute layer in operation 5039, If there are 
more images, the remaining names for the remaining images 
are obtained, and the associated image files are validated in 
operation 5036 and operation 5037, respectively. The image 5 
names are then stored within the descriptor in operation 
5038. When there are not any more images, it is then 
determined whether there are any more attribute layers to 
process in operation 5034. If there are more attribute layers, 
the entire operation 5010 repeats for the next attribute layer lO 
starting at operation 5012. If there are no more attribute 
layers, the process ends. 

FIG. 28 is a flowchart illustrating the operation 5014 of 
FIG. 27 for updating the builder layer table and attribute 
layer map. Initially, unused entries are removed from the IS 
builder layer table in operation 5040, That is, the layer table 
is updated to include any modifications to the construction 
site. If specific attribute instances have been deleted from the 
construction site, references to the attribute instance may 
also be deleted from the builder layer table. If specific 20 
attribute instances have been added to the construction site, 
references to the added attribute instances may be inserted 
within the builder layer table. 

The builder layer table is configured to contain a list of all 
attribute instances of the associated attribute layer that are 25 
used to populate the construction site. Thus, if a particular 
attribute instance no longer exists on the associated layer, an 
entry for the particular attribute instance will be deleted 
from the builder layer table in operation 5040. Likewise, if 
a particular attribute instance is being used and is not 30 
represented within the layer table, a reference is added to the 
table. 

Identifiers within the attribute layer map may then be 
renimibered to reflect any renumbering of the attribute 
instances referenced within the updated builder layer table in 35 
operation 5042, As attribute instances references are deleted 
from and/or added to the layer table, the references in the 
layer table are renumbered. These numbers are then asso- 
ciated with particular locations within the attribute layer 
map. 40 

For example, prior to modification a construction site may 
include three different floor attribute instances: a marble 
floor, a brick floor, and a slate floor. The attribute instances 
are numbered respectively within the layer table as 1, 2, and 
3. Likewise, within the associated attribute layer map, the 45 
location that contains a marble floor will be labeled as a 1; 
the location that contains the brick floor as a 2; and the 
location that contains the slate floor as a 3. 

After modification the construction site may include only 
two floor attribute instances: a marble floor and a brick floor. 50 
Until it is updated, the layer table includes references to the 
marble floor, the brick floor, and the slate floor. After the 
layer table is updated in operation 5040 to include only 
references to a marble floor object and a slate floor object, 
these object references are renumbered as 1 and 2, respec- 55 
tively. Within the attribute map, locations associated with a 
slate floor object wiU be renumbered as 2 to match the 
renumbered references within the layer table. 

FIG. 29 is a flowchart illustrating the operation 5600 of 
FIG. 26 for generating the birdseye view in accordance with 60 
one embodiment of the present invention. A similar process 
may be used to generate the populated construction site 
displayed within the builder tool 100. Initially, a grid outline 
is drawn in operation 5610. The grid may be divided into any 
suitable number and configuration of sections or locations. 65 
In one embodiment, the grid is divided into a 16x16 array of 
tiles. 
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A first or next attribute layer is obtained in operation 
5620. It is then determined whether the obtained attribute 
layer is visible in operation 5630. That is, some types of 
attribute layers (e.g., the ceiling, blocking, sound, and link 
layers) may be predefined as invisible so as to minimize a 
cluttered or restricted rendering of important objects within 
the birdseye view. Additionally, certain attribute layers may 
be selectably displayed or hidden within the construction 
site 601 or birdseye view of the viewer 102. 

If the attribute layer is not visible, there is no need to draw 
attribute instances from the invisible attribute layer onto the 
birdseye view. Thus, if the current attribute layer is not 
visible, operation 5620 is repeated and a next attribute layer 
is obtained. Visibility of particular attribute layers depends 
on whether a palette associated with the particular attribute 
layer is selected and/or whether a corresponding display 
button (e.g., the link display button 624) or any other type 
of selection mechanism is seleaed to display or hide the 
particular attribute layer. 

If the attribute layer is visible, a next or current location 
is obtained in operation 5640. A thumb nail image that will 
be displayed within the birdseye view is then obtained in 
operation 5650. The thumb nail image represents the 
attribute instance that is associated with the obtained loca- 
tion. The thumb nail image may be any suitable represen- 
tation. For example, it may be a reduced version of the 
image of the attribute instance that was selected from the 
palette and placed within the construction site. Alternatively, 
it may be in the form of a representative icon for the 
particular attribute instance, such as a musical note repre- 
senting a sound object. 

After the thumb nail image is obtained, it is then resized 
and drawn to fit within the grid at the particular location in 
operation 5660, In one embodiment, if other locations within 
the birdseye view or construction site 601 have the same 
thumb nail image or attribute instance, the resized thimabnail 
image is also drawn within the other locations. It is then 
determined whether there are any more locations in opera- 
tion 5661. If there arc more locations, a next location is 
obtained in operation 5640, and a thumb nail image is 
obtained for the next location in operation 5650. The thumb 
nail image is then resized and drawn at the next location in 
operation 5660. Operation 5640 through 5660 are repeated 
for any remaining locations for the current layer. 

When there are no more locations within the current layer, 
it is then determined whether there are any more layers in 
operation 5662. If there are more layers, a next layer is 
obtained in operation 5620, and 5630 through 5660 arc 
repeated for the obtained next layer. 

If the tour tab is selected and a tour route is being 
generated, the tour route is drawn within the birdseye view 
or construction site in operation 5670. After any tour routes 
are drawn over the thumbnail images of the bir<teeye view or 
construction site, it is then determined whether a populated 
construction site is being compiled in operation 5675. 

As described above, this process 5600 may be used to 
display the populated construction site 601 within the 
builder 100, and it may also be used to display the birdseye 
view map within the viewer 102. If the populated construc- 
tion site is being compiled for immediate use by the viewer 
102, it may be appropriate to generate a birdseye view in 
operation 5690. Alternatively, the viewer 102 may generate 
the birdseye view based on information within the data 
strucmre 106. If the populated constmction site is not being 
compiled, the populated construction site 601 is drawn 
within the builder 100 in operation 5680. 

Turning back to FIG. 26, after the image layers and the 
single images have been processed and validated. 
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respectively, one or more color palettes are constructed for 
the image file in operation 5080. Alternatively, color palettes 
may be constructed by the viewer 102 during rendering of 
the 3D world. 

FIG. 30 is a flowchart illustrating the operation 5080 of 
FIG. 26 for constructing the color palette in accordance with 
one embodiment of the present invention. Initially, it is 
determined which image files will have separately or col- 
lectively generated palettes in operation 5082. 

A palette may be generated for each image file, a plurality 
image files, or all of the image files. In general terms, the 
palette will include an optimal selection of colors based on 
the colors used within the associated image files. By way of 
example, the palette may include 256 colors that are selected 
from the most firequcntly used colors within the image files. 
That is, if the image files are rendered in 16 bit color, a 256 
color palette may be automatically generated by process 
5080. 

Of course, each palette may include any number of colors. 
By reducing the number of colors that are used by the image 
files, the transmission speed for the images files may be 
significantly reduced. Additionally, memory space and ren- 
dering speed may also be reduced when the image files and 
associated color palettes are used to generate the 3D world. 

After the image files are determined for each palette, a 
first or next palette is then instantiated in operation 5083. A 
histogram of RGB values is then constructed from the 
images associated with the current palette in operation 5084. 
A palette is then created based on the histogram in operation 
5086. Any suitable technique may be implemented for 
analyzing the images associated with the current palette to 
determine what colors to include within the palette. For 
example, a Median Cut Quantization process may be imple- 
mented. 

The palette is then applied to the designated image files in 
operation 5088. That is, the colors within the image files are 
converted into colors present within the associated palette. 
However, this may not be necessary if the number of colors 
within the image file are equal to or less than the number of 
colors within the palette. 

The generated palette is then stored in operation 5090. For 
example, the palette may be stored in a file referenced by the 
data structure. It is then determined whether there are any 
more palettes to construct in operation 5092. If there are 
more palettes, operation 5083 through 5090 are repeated. If 
there are no more palettes, the process ends. 

FIG. 31 is a flowchart illustrating the operation 5100 of 
FIG. 25 for processing non-image data. Initially, the attribute 
layers are processed in operation 5110. The non-image 
attribute layers may include any executable objects, such as 
sound objects, web links, and links to other data structuLres. 
The non-image attribute layers may also include video 
objects. General data is then validated in operation 5150. For 
example, a ceihng height may be based on a height of the 
taUesl wall object. 

FIG. 32 is a flowchart illustrating the operation 5100 of 
FIG, 31 for processing the attribute layer. Initially, a first or 
next attribute layer is obtained in operation 5112. It is then 
determined whether the obtained attribute layer has an 
associated buDder layer table in operation 5113 (e.g., wall 
height does not have an associated builder layer table). If 
present, the associated builder layer table will include ref- 
erences to various objects (e.g., image objects, data structure 
or world links, URL links, and sound objects). 

If an associated builder layer table is present, the layer 
table and its associated attribute maps are then updated in 
operation 5014. A descriptor is then initialized for the 
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current attribute layer in operation 5016. A first or next link 
is then obtained from the layer table in operation 5114 and 
validated in operation 5116. For example, if the link is in the 
form of a URL site, it is determined whether the URL site 

5 exists. A reference to the link is then stored within the 
descriptor in operation 5118. The reference may be any 
suitable format. For example, tbe reference may be in the 
form of a file name that corresponds to an executable file, or 
it may be in a form of a URL name. 

10 It is then determined whether there are any more links 
within the current attribute layer in operation 5119. If there 
are more links, the remaining links are added to the descrip- 
tor in operations 5114 through 5118. If there are no more 
Hnks, it is then determined whether there are any more 

15 attribute layers in operation 5120. If there are more attribute 
layers, the process 5110 repeats for the remaining attribute 
layers. If there are no more layers, the process ends. 

Returning to FIG. 25, after the non-image data image is 
processed in operation 5100, a data structure file is compiled 

20 in operation 5200. FIG. 33 is a flowchart illustrating the 
operation 5200 of FIG. 25 for compiling the data structure 
in accordance with one embodiment of the present inven- 
tion. Initially, a new data structure file is opened in operation 
5201. The general information is then written into the new 

25 data structure file in operation 5202. The attribute layer 
maps are then compressed and written into the data structure 
file in operation 5204. 

Any suitable techniques may be implemented for com- 
pressing the attribute layer maps. For example, a standard 

30 matrix compression technique may be implemented. During 
operation 5204, links fi-om different attribute layers may be 
combined into one layer Additionally, other attribute image 
layers may be combined. For example, the blocking attribute 
layer may be added to the wall attribute layer and repre- 
ss sented as a wall image object having a height equal to zero. 
The generated descriptors are then written into the data 
structure file in operation 5206, and the process 5200 ends. 

The builder 100 may be configured to allow editing of one 
or more palettes of attribute instances that are displayed 

40 within the attribute di^lay window 642. Any suitable inter- 
face may be implemented within the builder to facilitate 
palette editing. For example, an attribute instance or 
attribute instance image may be dragged firom a location 
outside of the palette (e.g., from a particular URL site) and 

45 dropped within a particular palette. Additionally, the builder 
may allow the same attribute instance to be cut or copied 
£rom an outside source and pasted within the particular 
palette. 

FIG. 34 is a flowchart illustrating a process 3400 for 

50 editing a particular palette of attribute instances within the 
builder of FIG. 1 in accordance with one embodiment of the 
present invention. Initially, a palette edit event is received in 
operation 3402. This palette edit event may take any suitable 
form (e.g., a drag and drop or a cut and paste operation as 

55 described above or a pull down menu that allows retrieval 
and placement of new attribute instances). 

Different mechanisms used by the builder 100 to edit a 
selected palette may result in slighdy different editing pro- 
cedures. For example, a "drag and drop" event may allow 

60 the user to specify a certain area within the target palette into 
which the new attribute object Is dropped. This feature may 
be useful for editing the "general" tab 620Jt, wherein the new 
attribute instance may be dropped within the background 
image area 656 or the emblem area 638. 

65 As shown, after an edit event is received, it is then 
determined whether a "drop" event has occurred in opera- 
tion 3404. If a drop event has occurred, a location is 
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determined for the drop event in operation 3406. A target is sprite object is created, the process 3500 for creating a sprite 

determined based on the determined drop location in opera- object then ends. 

tion 3408. The target information may facilitate placement Returning to FIG. 34, after an object is created, it is then 

of the new attribute instance into a hl)rary that is associated determined whether the object's name is unique within the 

with the particular drop location (e.g., a background library 5 target library in operation 3418. If the name is not unique, 

or an emblem library) the name is resolved in any suitable manner for resolving 

However, if it dcteraiined that a "drop" event has not °ame conflicts. For example, the user may be directed to 

occurred (e.g. a paste event has occurred), the target is set ^^^^ ^ new naine or replace the emtmg object having the 

based on the currenUy selected attribute layer (e.g., floor samename with the newly created object. By way of anot^^^ 

1 \ * . -jM^tx^c.t. *i 1 4 J * example, any of the unage objects may mclude a plurabty of 

palette) m operation 3410. If the currently selected attribute lO- / *u« - o -Au 

f . -J ^ c frames, such as the floor or ccilmg images. However, if the 

layer mcludes partitioned areas, a default area may be set as ^.^^^ ^^^^ ^^^^^^^^ ^^-^^^ ^ 

the target. stored within the relevant library in operation 3422. The 

After the target is set, an opUmal data type may then be process 3400 for editing the palette then ends, 
retrieved from the chpboard in operation 3412. The clip- Although the foregoing invention has been described in 
board may contain various data types, depending on which 15 some detail for purposes of clarity of understanding, it will 
type of attribute instance is being pasted or dropped. For be ^parent that certain changes and modifications may be 
example, the clipboard may contain a link to an image. In practiced within the scope of the appended claims. It should 
this example, the link may be used to retrieve the image for be noted that there are many alternative ways of implement- 
further processing, while the link is not used for further ing both the process and apparatus of the present invention, 
processing. 20 Accordingly, the present embodiments are to be considered 
The retrieved data is then validated in operation 3414, as illustrative and not restrictive, and the invention is not to 
Validation may include any checking or editing mechanisms be limited to the details given herein, but may be modified 
for ensturing that the data is valid. For example, if an image within die scope and equivalents of the appended claims, 
palette is the target (e.g., the floor palette), validation may What is claimed is: 

ensure that a sound object is not being placed within the 25 1. A data structure suitable for storing information usefiil 

image palette. By way of another example, each type of in constructing a three dimensional representation of infor- 

attribute layer may have specific size and shape require- mation via a viewable construction site that is conceptually 

ments for images that are associated with the attribute divided into a multiplicity of locations, wherein at least a 

layer's palette. By way of a final example, if an image is too portion of the locations instaoce(s) and with a column of 

large, a editing mechanism may allow resizing of the image. 30 space within the three dimensional representation, wherein 

After the retrieved daU is vahdated, an object is created the population of attribute instance(s) of each construction 

based on the data in operation 3416. Any suitable type of site location correspond to different audiovisual components 

objea may be created for displaying or executing within a that are presented with the associated column of space of the 

3D world. For example, the created object may be in the three dimensional representation; and 

form of an animated 3D object, a static 3D object, a sound 35 a plurality of attribute descriptors, each attribute descrip- 

object, or any other type of executable object. tor being associated with one of the attribute maps and 

FIG. 35 is a flowchart illustrating the process 3500 of being arranged to reference specific attribute instances 

creating a sprite object in accordance with one embodiment associated with the associated attribute map. 

ofthe present invention. In one embodiment, the builder 100 2. A data structure as recited in claim 1, wherein each 

may be configured to allow the addition of a plurality of 40 attribute map has a plurality of identifiers, wherein each 

images to a selected palette. These images may be used identifier is associated with a specific location within the 

together to create a single object or used to create separate construction site and a specific attribute instance, 

objects based on each image within the selected palette. 3. A data structure as recited in claim 2, wherein each 

Initially, it is determined whether more than one image attribute descriptor is formatted to match specific identifiers 

has been dropped or pasted within the selected palette in 45 ofthe associated attribute map to specific attribute instances, 

operation 3502. If only a single image has been added to the 4. A data structure as recited in claim 3, wherein specific 

palette, it is stored as a single sprite object. In one identifiers are matched within the descriptors to specific 

embodiment, the single image is used to create a single- attribute instances located within the descriptors, 

faced sprite object that has a single face that is displayed at 5. A data structure as recited in claim 4, wherein other 

each viewing angle. 50 specific identifiers are matched within the descriptor to 

If, however, more than one image has been placed within specific indexes that reference specific attribute instances 

the selected palette, it is then determined whether the sprite located outside of the descriptors. 

object is to be animated in operation 3504. If it is not to be 6. A data stnicmre as recited in claim 3, wherein specific 

animated, the images are also stored as single objects in identifiers are matched within the descriptor to specific 

operation 3502. In this case, each of the images may be used 55 indexes that reference specific attribute instances located 

as a single-faced sprite object. outside of the descriptors. 

If the sprite image is to be animated, the images are 7. A data structure as recited .in claim 3, wherein specific 

combined into an animated ^rite object in operation 3506. attribute instances are in the form of specific image objects 

In one embodiment, each image is used for a particular that are referenced by specific start addresses within a 

frame or side of the sprite object. The images may be 60 bitmap file, the specific image objects being displayable at 

arranged in any suitable order. For example, the images may specific locations within the three dimensional representa- 

be arranged alphabetically by name. That is, the first image tion. 

is used for the first displayed frame of the sprite object; the 8. A data stnicmre as recited in claim 1, wherein each 

second image is used for the second frame; etc, attribute instance is selected from a group consisting of an 

Alternatively, the user may be given a group of thumb nail 65 object and a link, and the object and link each being 

images that correspond to the placed images and asked to displayable or executable within the corresponding column 

choose the order of the images. Animated or not, after the of space within the three dimensional representation. 
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9. A data structure as recited in clairo 1, wherein each 
attribute instance is selected firom a group consisting of an 
image object, a video object, a sound object, a sprite object, 
an executable object, a URL, and a link to another data 
structure that are each displayable or executable at the 5 
associated column of space with the three dimensional 
representation. 

10. A data structure as recited in claim 1, wherein at least 
one of the attribute instances is a value that defines a 
characteristic of the three dimensional representation at a 10 
specific location in the construction site. 

11. A data structure as recited in claim 1, further com- 
prising general data that specifies a plurality of characteris- 
tics of the three dimensional representation of information in 
the viewable construction site or of the construction site. 15 

12. A data structure as recited in claim U, wherein a first 
characteristic indicates a height of the viewable construction 
site or of the three dimensional representation of informa- 
tion. 

13. A data structure as recited in claim U, wherein a first 20 
characteristic indicates whether a particular attribute 
instance is associated with any of the attribute maps. 

14. A data structure as recited in claim U, wherein a first 
characteristic indicates a default user perspective with 
respect to the three dimensional representation. 25 

15. A data structure as recited in claim 14, wherein the 
default user perspective is selected from a group consisting 
of a starting position, a viewing height, a viewing direction, 
an environmental reaction type, and a speed of movement 
within the three dimensional representation. 30 

16. A data structure as recited in claim 1, further com- 
prising general data that ^ecifies a two dimensional repre- 
sentation of information associated with the three dimen- 
sional representation. 

17. A data structure as recited in claim 16, wherein the two 35 
dimensional representation is a birdseyc view of the three 
dimensional representation. 

18. A data structure as recited in claim 16, wherein the 
general data also ^ecifies a viewable symbol that indicates 

a group to which the three dimensional representation 40 
belongs. 

19. A method for generating a three dimensional repre- 
sentation via a viewable construction site having a plurality 
of sections, each section having a plurality of associated 
attribute layeis, the method comprising: 45 

instantiating a new construction site associated with the 
three dimensional representation, wherein each section 
within the new construction site corresponds to a 
column of space within the three dimensional repre- 
sentation; 50 

selecting a first attribute layer from the plurality of 
attribute layers that corresponds to a plurality of col- 
umns of space within the three dimensional 
representation, wherein the plurality of layers associ- 
ated wit a particular section of the construction site 
corre^onds to different audiovisual components that 
are presented within the associated column of space of 
the three dimensional representation; 

displaying a first palette that includes a first plurality of 
attribute instances associated with the fist attribute 
layer; 

selecting a first attribute instance fi-om the first palette; 
and 

painting the first attribute instance on one or more sec- 65 
tions of the construction site, wherein the painted on 
first attribute instances will be presented within the 
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corre^onding columns within the three dimensional 
representation. 

20. A method as recited in claim 19, further comprising: 
selecting a second attribute layer that corresponds to the 

same plurahty of columns of space within the three 
dimensional representation as the first attribute layer; 

displaying a second palette that includes a second plural- 
ity of attribute instances associated with the second 
attribute layer; 

selecting a second attribute instance from the second 
palette; and 

painting the second attribute instance on one or more 
sections of the construction site, wherein the first and 
second attribute instances are painted onto at least one 
common section, wherein the painted on second 
attribute instances will be presented with the corre- 
sponding one or more columns within the three dimen- 
sional representation. 

21. A method as recited in claim 19, further comprising 
selecting a plurahty of general settings for how the three 
dimensional representation will be displayed. 

22. A method as recited in claim 20, wherein the first and 
second attribute instances are each selected from a different 
instance type selected from a group consisting of a floor 
image, a wall image, or a ceiling image. 

23. A method as recited in claim 22, further comprising: 
selecting a third attribute layer that corresponds to the 

same plurality of columns of space within the three 
dimensional representation as the first attribute layer; 
displaying a third palette that includes a third plurality of 
attribute instances associated with the third attribute 
layer; 

selecting a third attribute instance fi'om the second palette; 
and 

painting the third attribute instance on one or more 
sections of the construction site, wherein the third 
attribute instance is painted onto at least a section in 
common with the first or second attribute instance, 
wherein the painted on third attribute instances will be 
executed or associated with the corresponding one or 
more columns within the three dimensional represen- 
tation. 

24. A method as recited in claim 23, wherein the third 
attribute instance is selected from an instance type selected 
from a group consisting of a web link, a link to another three 
dimensional representation, and an executable object. 

25. A method as recited in claim 24, wherein the execut- 
able audiovisual object is a computer video chp. 

26. A computer readable medium containing program 
instructions for generating a three dimensional representa- 
tion via a viewable construction site having a plurality of 
sections, each section having a plurality of associated 
attribute layers, comprising: 

computer readable code for instantiating a new construc- 
tion site associated with the three dimensional 
representation, wherein each section within the new 
construction site corresponds to a column of space 
within the three dimensional representation; 

computer readable code for allowing selection of a first 
attribute layer firom the plurality of attribute layers that 
corre^onds to a plurality of columns of space within 
the three dimensional representation, wherein the plu- 
rahty of layers associated with a particular seaion of 
the construction site corresponds to different audiovi- 
sual components that are presented within the associ- 
ated colinnn of space of fiie three dimensional repre- 
sentation; 
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computer readable code for di^laying a first palette that 
includes a first plurality of attribute instances associ- 
ated with the first attribute layer; 

computer readable code for allowing selection of a first 
attribute instance from the first palette; and 

computer readable code for allowing a painting operation 
of the first attribute instance on one or more sections of 
the construction site, wherein the painted on first 
attribute instances will be presented within the corre- 
sponding columns within the three dimensional repre- 
sentation; and 

a computer readable medium that stores the computer 
codes. 

27. A computer readable medium as recited in claim 26, 
further comprising: 

computer readable code for allowing selection of a second 
attribute layer that corresponds to the same plurality of 
columns of space within the three dimensional repre- 
sentation as the first attribute layer; 

computer readable code for displaying a second palette 
that includes a second plurality of attribute instances 
associated with the second attribute layer; 

computer readable code for allowing selection of a second 
attribute instance from the second palette; and 

computer readable code for allowing a painting operation 
of the second attribute instance on one or more sections 
of the construction site, wherein the first and second 
attribute instances may be painted onto at least one 
common section; and 

computer readable code for presenting the painted on 
second attribute instances within the corresponding one 
or more columns within the tree dimensional presen- 
tation. 



IS 



20 



30 



28. A computer readable medium as recited in claim 27, 
wherein the first and second attribute instances are each 
selected from a different instance type selected from a group 
consisting of a floor image, a wall image, or a ceiling image. 

29. A computer readable medium as recited in claim 28, 
further comprising: 

computer readable code for allowing selection of a third 
attribute layer that corresponds to the same plurality of 
columns of space within the three dimensional repre- 
sentation as the first attribute layer; 

computer readable code for displaying a third palette that 
includes a third plurality of attribute instances associ- 
ated with the third attribute layer; 

computer readable code for allowing selection of a third 
attribute instance from the second palette; 

computer readable code for painting the third attribute 
instance on one or more sections of the construction 
site, wherein the third attribute instance may be painted 
onto at least a section in common with the first or 
second attribute instance; and 

computer readable code for executing or associating the 
painted on third attribute instances within the corre- 
sponding one or more columns within the three dimen- 
sional representation. 

30. A computer readable medium as recited in claim 29, 
wherein the third attribute instance is selected from an 
instance type selected from a group consisting of a web Knk, 
a link to another three dimensional representation, and an 
executable object. 
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